Aug 15 06:51:16 user nova-compute[72803]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 06:51:19 user nova-compute[72803]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72803) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72803) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72803) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 06:51:19 user nova-compute[72803]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:51:19 user nova-compute[72803]: INFO nova.virt.driver [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 06:51:19 user nova-compute[72803]: INFO nova.compute.provider_config [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] Acquiring lock "singleton_lock" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] Acquired lock "singleton_lock" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] Releasing lock "singleton_lock" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] Full set of CONF: {{(pid=72803) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ******************************************************************************** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] Configuration options gathered from: {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ================================================================================ {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] allow_resize_to_same_host      = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] arq_binding_timeout            = 300 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] backdoor_port                  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] backdoor_socket                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] block_device_allocate_retries  = 300 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] block_device_allocate_retries_interval = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cert                           = self.pem {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute_monitors               = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] config_dir                     = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] config_drive_format            = iso9660 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] config_source                  = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] console_host                   = user {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] control_exchange               = nova {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cpu_allocation_ratio           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] daemon                         = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] debug                          = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] default_access_ip_network_name = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] default_availability_zone      = nova {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] default_ephemeral_format       = ext4 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] default_schedule_zone          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] disk_allocation_ratio          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] enable_new_services            = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] enabled_ssl_apis               = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] flat_injected                  = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] force_config_drive             = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] force_raw_images               = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] graceful_shutdown_timeout      = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] heal_instance_info_cache_interval = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] host                           = user {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] instance_build_timeout         = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] instance_delete_interval       = 300 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] instance_name_template         = instance-%08x {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] instance_usage_audit           = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] instance_usage_audit_period    = month {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] internal_service_availability_zone = internal {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] key                            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] live_migration_retry_count     = 30 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] log_config_append              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] log_dir                        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] log_file                       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] log_options                    = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] log_rotate_interval            = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] log_rotate_interval_type       = days {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] log_rotation_type              = none {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] long_rpc_timeout               = 1800 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] max_concurrent_builds          = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] max_concurrent_live_migrations = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] max_concurrent_snapshots       = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] max_local_block_devices        = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] max_logfile_count              = 30 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] max_logfile_size_mb            = 200 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] maximum_instance_delete_attempts = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] metadata_listen                = 0.0.0.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] metadata_listen_port           = 8775 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] metadata_workers               = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] migrate_max_retries            = -1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] mkisofs_cmd                    = genisoimage {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] my_ip                          = 10.0.0.210 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] network_allocate_retries       = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] osapi_compute_listen_port      = 8774 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] osapi_compute_unique_server_name_scope =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] osapi_compute_workers          = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] password_length                = 12 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] periodic_enable                = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] periodic_fuzzy_delay           = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] pointer_model                  = ps2mouse {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] preallocate_images             = none {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] publish_errors                 = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] pybasedir                      = /opt/stack/nova {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ram_allocation_ratio           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] rate_limit_burst               = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] rate_limit_except_level        = CRITICAL {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] rate_limit_interval            = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] reboot_timeout                 = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] reclaim_instance_interval      = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] record                         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] reimage_timeout_per_gb         = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] report_interval                = 120 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] rescue_timeout                 = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] reserved_host_cpus             = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] reserved_host_disk_mb          = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] reserved_host_memory_mb        = 512 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] reserved_huge_pages            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] resize_confirm_window          = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] resize_fs_using_block_device   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] resume_guests_state_on_host_boot = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] rpc_response_timeout           = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] run_external_periodic_tasks    = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] running_deleted_instance_action = reap {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] running_deleted_instance_timeout = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler_instance_sync_interval = 120 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_down_time              = 720 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] servicegroup_driver            = db {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] shelved_offload_time           = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] shelved_poll_interval          = 3600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] shutdown_timeout               = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] source_is_ipv6                 = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ssl_only                       = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] state_path                     = /opt/stack/data/nova {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] sync_power_state_interval      = 600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] sync_power_state_pool_size     = 1000 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] syslog_log_facility            = LOG_USER {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] tempdir                        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] timeout_nbd                    = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] transport_url                  = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] update_resources_interval      = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] use_cow_images                 = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] use_eventlog                   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] use_journal                    = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] use_json                       = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] use_rootwrap_daemon            = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] use_stderr                     = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] use_syslog                     = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vcpu_pin_set                   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plugging_is_fatal          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plugging_timeout           = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] virt_mkfs                      = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] volume_usage_poll_interval     = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] watch_log_file                 = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] web                            = /usr/share/spice-html5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_concurrency.disable_process_locking = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.auth_strategy              = keystone {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.compute_link_prefix        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.dhcp_domain                = novalocal {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.enable_instance_password   = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.glance_link_prefix         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.instance_list_per_project_cells = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.list_records_by_skipping_down_cells = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.local_metadata_per_cell    = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.max_limit                  = 1000 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.metadata_cache_expiration  = 15 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.neutron_default_tenant_id  = default {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.use_forwarded_for          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.use_neutron_default_nets   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.vendordata_dynamic_targets = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.vendordata_jsonfile_path   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.backend_argument         = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.config_prefix            = cache.oslo {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.dead_timeout             = 60.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.debug_cache_backend      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.enable_retry_client      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.enable_socket_keepalive  = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.enabled                  = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.expiration_time          = 600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.hashclient_retry_attempts = 2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_dead_retry      = 300 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_password        =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_sasl_enabled    = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.memcache_username        =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.proxies                  = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.retry_attempts           = 2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.retry_delay              = 0.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.socket_keepalive_count   = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.socket_keepalive_idle    = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.socket_keepalive_interval = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.tls_allowed_ciphers      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.tls_cafile               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.tls_certfile             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.tls_enabled              = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cache.tls_keyfile              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.auth_section            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.auth_type               = password {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.cafile                  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.certfile                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.collect_timing          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.cross_az_attach         = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.debug                   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.endpoint_template       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.http_retries            = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.insecure                = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.keyfile                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.os_region_name          = RegionOne {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.split_loggers           = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cinder.timeout                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.cpu_dedicated_set      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.cpu_shared_set         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.image_type_exclude_list = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.resource_provider_association_refresh = 300 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.shutdown_retry_interval = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] conductor.workers              = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] console.allowed_origins        = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] console.ssl_ciphers            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] console.ssl_minimum_version    = default {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] consoleauth.token_ttl          = 600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.cafile                  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.certfile                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.collect_timing          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.connect_retries         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.connect_retry_delay     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.endpoint_override       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.insecure                = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.keyfile                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.max_version             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.min_version             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.region_name             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.service_name            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.service_type            = accelerator {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.split_loggers           = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.status_code_retries     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.status_code_retry_delay = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.timeout                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] cyborg.version                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.backend               = sqlalchemy {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.connection            = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.connection_debug      = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.connection_parameters =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.connection_recycle_time = 3600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.connection_trace      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.db_inc_retry_interval = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.db_max_retries        = 20 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.db_max_retry_interval = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.db_retry_interval     = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.max_overflow          = 50 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.max_pool_size         = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.max_retries           = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.mysql_enable_ndb      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.mysql_wsrep_sync_wait = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.pool_timeout          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.retry_interval        = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.slave_connection      = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] database.sqlite_synchronous    = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.backend           = sqlalchemy {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.connection        = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.connection_debug  = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.connection_parameters =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.connection_recycle_time = 3600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.connection_trace  = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.db_inc_retry_interval = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.db_max_retries    = 20 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.db_max_retry_interval = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.db_retry_interval = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.max_overflow      = 50 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.max_pool_size     = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.max_retries       = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.mysql_enable_ndb  = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.pool_timeout      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.retry_interval    = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.slave_connection  = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] api_database.sqlite_synchronous = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] devices.enabled_mdev_types     = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ephemeral_storage_encryption.enabled = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.api_servers             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.cafile                  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.certfile                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.collect_timing          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.connect_retries         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.connect_retry_delay     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.debug                   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.default_trusted_certificate_ids = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.enable_certificate_validation = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.enable_rbd_download     = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.endpoint_override       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.insecure                = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.keyfile                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.max_version             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.min_version             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.num_retries             = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.rbd_ceph_conf           =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.rbd_connect_timeout     = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.rbd_pool                =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.rbd_user                =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.region_name             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.service_name            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.service_type            = image {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.split_loggers           = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.status_code_retries     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.status_code_retry_delay = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.timeout                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.verify_glance_signatures = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] glance.version                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] guestfs.debug                  = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.config_drive_cdrom      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.config_drive_inject_password = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.enable_remotefx         = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.instances_path_share    =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.limit_cpu_features      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.use_multipath_io        = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.vswitch_name            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] mks.enabled                    = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] image_cache.manager_interval   = 2400 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] image_cache.precache_concurrency = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] image_cache.remove_unused_base_images = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] image_cache.subdirectory_name  = _base {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.api_max_retries         = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.api_retry_interval      = 2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.auth_section            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.auth_type               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.cafile                  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.certfile                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.collect_timing          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.connect_retries         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.connect_retry_delay     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.endpoint_override       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.insecure                = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.keyfile                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.max_version             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.min_version             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.partition_key           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.peer_list               = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.region_name             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.serial_console_state_timeout = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.service_name            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.service_type            = baremetal {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.split_loggers           = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.status_code_retries     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.status_code_retry_delay = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.timeout                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ironic.version                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] key_manager.fixed_key          = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.barbican_api_version  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.barbican_endpoint     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.barbican_endpoint_type = public {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.barbican_region_name  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.cafile                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.certfile              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.collect_timing        = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.insecure              = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.keyfile               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.number_of_retries     = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.retry_delay           = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.send_service_user_token = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.split_loggers         = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.timeout               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.verify_ssl            = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican.verify_ssl_path       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.auth_section = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.auth_type = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.cafile   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.certfile = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.collect_timing = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.insecure = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.keyfile  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.split_loggers = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] barbican_service_user.timeout  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.approle_role_id          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.approle_secret_id        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.cafile                   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.certfile                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.collect_timing           = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.insecure                 = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.keyfile                  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.kv_mountpoint            = secret {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.kv_version               = 2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.namespace                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.root_token_id            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.split_loggers            = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.ssl_ca_crt_file          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.timeout                  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.use_ssl                  = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.cafile                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.certfile              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.collect_timing        = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.connect_retries       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.connect_retry_delay   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.endpoint_override     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.insecure              = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.keyfile               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.max_version           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.min_version           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.region_name           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.service_name          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.service_type          = identity {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.split_loggers         = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.status_code_retries   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.status_code_retry_delay = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.timeout               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] keystone.version               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.connection_uri         =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.cpu_mode               = custom {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: WARNING oslo_config.cfg [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.cpu_power_governor_high = performance {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.cpu_power_management   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.device_detach_attempts = 8 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.device_detach_timeout  = 20 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.disk_cachemodes        = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.disk_prefix            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.enabled_perf_events    = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.file_backed_memory     = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.gid_maps               = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.hw_disk_discard        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.hw_machine_type        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.images_rbd_pool        = rbd {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.images_type            = default {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.images_volume_group    = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.inject_key             = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.inject_partition       = -2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.inject_password        = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.iscsi_iface            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.iser_use_multipath     = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_downtime = 500 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_inbound_addr = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_scheme  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_timeout_action = abort {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_tunnelled = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: WARNING oslo_config.cfg [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 06:51:19 user nova-compute[72803]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 06:51:19 user nova-compute[72803]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 06:51:19 user nova-compute[72803]: and ``live_migration_inbound_addr`` respectively.
Aug 15 06:51:19 user nova-compute[72803]: ).  Its value may be silently ignored in the future.
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.live_migration_with_native_tls = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.max_queues             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.nfs_mount_options      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.num_pcie_ports         = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.pmem_namespaces        = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.quobyte_client_cfg     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rbd_secret_uuid        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rbd_user               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rescue_image_id        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rescue_kernel_id       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.rx_queue_size          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.smbfs_mount_options    =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.snapshot_compression   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.snapshot_image_format  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.sparse_logical_volumes = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.swtpm_enabled          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.swtpm_group            = tss {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.swtpm_user             = tss {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.sysinfo_serial         = unique {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.tb_cache_size          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.tx_queue_size          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.uid_maps               = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.use_virtio_for_bridges = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.virt_type              = kvm {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.volume_clear           = zero {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.volume_clear_size      = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.volume_use_multipath   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.vzstorage_cache_path   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.auth_section           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.auth_type              = password {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.cafile                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.certfile               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.collect_timing         = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.connect_retries        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.connect_retry_delay    = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.default_floating_pool  = public {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.endpoint_override      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.extension_sync_interval = 600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.http_retries           = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.insecure               = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.keyfile                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.max_version            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.min_version            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.ovs_bridge             = br-int {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.physnets               = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.region_name            = RegionOne {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.service_metadata_proxy = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.service_name           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.service_type           = network {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.split_loggers          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.status_code_retries    = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.status_code_retry_delay = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.timeout                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] neutron.version                = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] notifications.bdms_in_notifications = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] notifications.default_level    = INFO {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] notifications.notification_format = unversioned {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] notifications.notify_on_state_change = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] pci.alias                      = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] pci.device_spec                = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] pci.report_in_placement        = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.auth_section         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.auth_type            = password {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.cafile               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.certfile             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.collect_timing       = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.connect_retries      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.connect_retry_delay  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.default_domain_id    = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.default_domain_name  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.domain_id            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.domain_name          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.endpoint_override    = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.insecure             = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.keyfile              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.max_version          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.min_version          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.password             = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.project_domain_id    = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.project_domain_name  = Default {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.project_id           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.project_name         = service {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.region_name          = RegionOne {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.service_name         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.service_type         = placement {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.split_loggers        = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.status_code_retries  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.status_code_retry_delay = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.system_scope         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.timeout              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.trust_id             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.user_domain_id       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.user_domain_name     = Default {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.user_id              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.username             = placement {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] placement.version              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.cores                    = 20 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.count_usage_from_placement = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.injected_file_content_bytes = 10240 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.injected_file_path_length = 255 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.injected_files           = 5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.instances                = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.key_pairs                = 100 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.metadata_items           = 128 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.ram                      = 51200 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.recheck_quota            = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.server_group_members     = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] quota.server_groups            = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] rdp.enabled                    = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.image_metadata_prefilter = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.max_attempts         = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.max_placement_results = 1000 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] scheduler.workers              = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.host_subset_size = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.isolated_hosts = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.isolated_images = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.pci_in_placement = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.track_instance_changes = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] metrics.required               = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] metrics.weight_multiplier      = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] metrics.weight_setting         = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] serial_console.enabled         = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] serial_console.port_range      = 10000:20000 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] serial_console.serialproxy_port = 6083 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.auth_section      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.auth_type         = password {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.cafile            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.certfile          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.collect_timing    = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.insecure          = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.keyfile           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.send_service_user_token = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.split_loggers     = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] service_user.timeout           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.agent_enabled            = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.enabled                  = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.html5proxy_port          = 6082 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.image_compression        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.jpeg_compression         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.playback_compression     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.server_listen            = 127.0.0.1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.streaming_mode           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] spice.zlib_compression         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] upgrade_levels.baseapi         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] upgrade_levels.cert            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] upgrade_levels.compute         = auto {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] upgrade_levels.conductor       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] upgrade_levels.scheduler       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.cafile = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.certfile = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.insecure = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vendordata_dynamic_auth.timeout = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.api_retry_count         = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.ca_file                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.cache_prefix            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.cluster_name            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.connection_pool_size    = 10 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.console_delay_seconds   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.datastore_regex         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.host_ip                 = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.host_password           = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.host_port               = 443 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.host_username           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.insecure                = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.integration_bridge      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.maximum_objects         = 100 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.pbm_default_policy      = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.pbm_enabled             = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.pbm_wsdl_location       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.serial_port_proxy_uri   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.serial_port_service_uri = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.task_poll_interval      = 0.5 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.use_linked_clone        = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.vnc_keymap              = en-us {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.vnc_port                = 5900 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vmware.vnc_port_total          = 10000 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.auth_schemes               = ['none'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.enabled                    = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.novncproxy_port            = 6080 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.vencrypt_ca_certs          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.vencrypt_client_cert       = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vnc.vencrypt_client_key        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.disable_rootwrap   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.enable_numa_live_migration = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.libvirt_disable_apic = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.client_socket_timeout     = 900 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.default_pool_size         = 1000 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.keep_alive                = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.max_header_line           = 16384 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.ssl_ca_file               = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.ssl_cert_file             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:19 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.ssl_key_file              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.tcp_keepidle              = 600 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] zvm.ca_file                    = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] zvm.cloud_connector_url        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] zvm.reachable_timeout          = 300 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.enforce_new_defaults = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.enforce_scope      = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.policy_default_rule = default {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.connection_string     = messaging:// {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.enabled               = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.es_doc_type           = notification {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.es_scroll_size        = 10000 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.es_scroll_time        = 2m {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.filter_error_trace    = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.hmac_keys             = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.sentinel_service_name = mymaster {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.socket_timeout        = 0.1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.trace_requests        = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler.trace_sqlalchemy      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler_jaeger.process_tags   = {} {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler_jaeger.service_name_prefix = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] profiler_otlp.service_name_prefix = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] remote_debug.host              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] remote_debug.port              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_notifications.retry = -1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.auth_section        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.auth_type           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.cafile              = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.certfile            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.collect_timing      = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.connect_retries     = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.connect_retry_delay = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.endpoint_id         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.endpoint_override   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.insecure            = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.keyfile             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.max_version         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.min_version         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.region_name         = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.service_name        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.service_type        = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.split_loggers       = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.status_code_retries = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.status_code_retry_delay = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.timeout             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.valid_interfaces    = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_limit.version             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_reports.file_event_handler = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] oslo_reports.log_dir           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_ovs_privileged.group  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] vif_plug_ovs_privileged.user   = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_ovs.isolate_vif         = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] os_brick.lock_path             = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] privsep_osbrick.capabilities   = [21] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] privsep_osbrick.group          = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] privsep_osbrick.helper_command = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] privsep_osbrick.user           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] nova_sys_admin.group           = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] nova_sys_admin.helper_command  = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] nova_sys_admin.user            = None {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG oslo_service.service [None req-0187f83d-36bf-43c3-8054-7297dc09dc28 None None] ******************************************************************************** {{(pid=72803) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 06:51:20 user nova-compute[72803]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 06:51:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Starting native event thread {{(pid=72803) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Starting green dispatch thread {{(pid=72803) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Starting connection event dispatch thread {{(pid=72803) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Connecting to libvirt: qemu:///system {{(pid=72803) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f3503f40d60> {{(pid=72803) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 06:51:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f3503f40d60> {{(pid=72803) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 06:51:20 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Connection event '1' reason 'None'
Aug 15 06:51:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 06:51:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.mount [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Initialising _HostMountState generation 0 {{(pid=72803) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 06:51:27 user nova-compute[72803]: INFO nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host capabilities <capabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <host>
Aug 15 06:51:27 user nova-compute[72803]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 06:51:27 user nova-compute[72803]:     <cpu>
Aug 15 06:51:27 user nova-compute[72803]:       <arch>x86_64</arch>
Aug 15 06:51:27 user nova-compute[72803]:       <model>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <microcode version='1070'/>
Aug 15 06:51:27 user nova-compute[72803]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 06:51:27 user nova-compute[72803]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='osxsave'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='invtsc'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='rsba'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 06:51:27 user nova-compute[72803]:       <pages unit='KiB' size='4'/>
Aug 15 06:51:27 user nova-compute[72803]:       <pages unit='KiB' size='2048'/>
Aug 15 06:51:27 user nova-compute[72803]:     </cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <power_management>
Aug 15 06:51:27 user nova-compute[72803]:       <suspend_mem/>
Aug 15 06:51:27 user nova-compute[72803]:       <suspend_disk/>
Aug 15 06:51:27 user nova-compute[72803]:       <suspend_hybrid/>
Aug 15 06:51:27 user nova-compute[72803]:     </power_management>
Aug 15 06:51:27 user nova-compute[72803]:     <iommu support='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <migration_features>
Aug 15 06:51:27 user nova-compute[72803]:       <live/>
Aug 15 06:51:27 user nova-compute[72803]:       <uri_transports>
Aug 15 06:51:27 user nova-compute[72803]:         <uri_transport>tcp</uri_transport>
Aug 15 06:51:27 user nova-compute[72803]:         <uri_transport>rdma</uri_transport>
Aug 15 06:51:27 user nova-compute[72803]:       </uri_transports>
Aug 15 06:51:27 user nova-compute[72803]:     </migration_features>
Aug 15 06:51:27 user nova-compute[72803]:     <topology>
Aug 15 06:51:27 user nova-compute[72803]:       <cells num='2'>
Aug 15 06:51:27 user nova-compute[72803]:         <cell id='0'>
Aug 15 06:51:27 user nova-compute[72803]:           <memory unit='KiB'>8189224</memory>
Aug 15 06:51:27 user nova-compute[72803]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 15 06:51:27 user nova-compute[72803]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 06:51:27 user nova-compute[72803]:           <distances>
Aug 15 06:51:27 user nova-compute[72803]:             <sibling id='0' value='10'/>
Aug 15 06:51:27 user nova-compute[72803]:             <sibling id='1' value='20'/>
Aug 15 06:51:27 user nova-compute[72803]:           </distances>
Aug 15 06:51:27 user nova-compute[72803]:           <cpus num='6'>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 06:51:27 user nova-compute[72803]:           </cpus>
Aug 15 06:51:27 user nova-compute[72803]:         </cell>
Aug 15 06:51:27 user nova-compute[72803]:         <cell id='1'>
Aug 15 06:51:27 user nova-compute[72803]:           <memory unit='KiB'>8206460</memory>
Aug 15 06:51:27 user nova-compute[72803]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 15 06:51:27 user nova-compute[72803]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 06:51:27 user nova-compute[72803]:           <distances>
Aug 15 06:51:27 user nova-compute[72803]:             <sibling id='0' value='20'/>
Aug 15 06:51:27 user nova-compute[72803]:             <sibling id='1' value='10'/>
Aug 15 06:51:27 user nova-compute[72803]:           </distances>
Aug 15 06:51:27 user nova-compute[72803]:           <cpus num='6'>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 06:51:27 user nova-compute[72803]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 06:51:27 user nova-compute[72803]:           </cpus>
Aug 15 06:51:27 user nova-compute[72803]:         </cell>
Aug 15 06:51:27 user nova-compute[72803]:       </cells>
Aug 15 06:51:27 user nova-compute[72803]:     </topology>
Aug 15 06:51:27 user nova-compute[72803]:     <cache>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 06:51:27 user nova-compute[72803]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 06:51:27 user nova-compute[72803]:     </cache>
Aug 15 06:51:27 user nova-compute[72803]:     <secmodel>
Aug 15 06:51:27 user nova-compute[72803]:       <model>apparmor</model>
Aug 15 06:51:27 user nova-compute[72803]:       <doi>0</doi>
Aug 15 06:51:27 user nova-compute[72803]:     </secmodel>
Aug 15 06:51:27 user nova-compute[72803]:     <secmodel>
Aug 15 06:51:27 user nova-compute[72803]:       <model>dac</model>
Aug 15 06:51:27 user nova-compute[72803]:       <doi>0</doi>
Aug 15 06:51:27 user nova-compute[72803]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 06:51:27 user nova-compute[72803]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 06:51:27 user nova-compute[72803]:     </secmodel>
Aug 15 06:51:27 user nova-compute[72803]:   </host>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='alpha'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>clipper</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='armv6l'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>spitz</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>nuri</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>kzm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sx1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>z2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>tosa</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>n810</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>n800</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>terrier</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>midway</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>microbit</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>verdex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>highbank</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>akita</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>connex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>collie</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='armv7l'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>spitz</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>nuri</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>kzm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sx1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>z2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>tosa</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>n810</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>n800</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>terrier</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>midway</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>microbit</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>verdex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>highbank</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>akita</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>connex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>collie</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='aarch64'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>spitz</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>nuri</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>kzm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sx1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>z2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>tosa</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>n810</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>n800</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>terrier</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>midway</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>microbit</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>verdex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>highbank</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>akita</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>connex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>collie</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <acpi default='on' toggle='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='cris'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='i686'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>isapc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>microvm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='kvm'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <pae/>
Aug 15 06:51:27 user nova-compute[72803]:       <nonpae/>
Aug 15 06:51:27 user nova-compute[72803]:       <acpi default='on' toggle='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:       <apic default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='m68k'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>an5206</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>q800</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='microblaze'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='microblazeel'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='mips'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='16'>malta</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='mipsel'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='16'>malta</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='mips64'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='16'>malta</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>pica61</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>magnum</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='mips64el'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='16'>malta</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>pica61</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>magnum</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='16'>boston</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='ppc'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mac99</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>40p</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>taihu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='ppc64'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>taihu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>40p</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mac99</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='ppc64le'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>taihu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>40p</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>mac99</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='riscv32'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='8'>spike</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='8'>virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='riscv64'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='8'>spike</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='8'>virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='s390x'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='sh4'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>shix</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>r2d</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='sh4eb'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>shix</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>r2d</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='sparc'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>LX</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='sparc64'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>niagara</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='x86_64'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>64</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='1'>isapc</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>microvm</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='kvm'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <acpi default='on' toggle='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:       <apic default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='xtensa'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>sim</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>kc705</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>ml605</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>lx200</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>lx60</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]:   <guest>
Aug 15 06:51:27 user nova-compute[72803]:     <os_type>hvm</os_type>
Aug 15 06:51:27 user nova-compute[72803]:     <arch name='xtensaeb'>
Aug 15 06:51:27 user nova-compute[72803]:       <wordsize>32</wordsize>
Aug 15 06:51:27 user nova-compute[72803]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='4'>sim</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>kc705</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>ml605</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>virt</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>lx200</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>lx60</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 06:51:27 user nova-compute[72803]:       <domain type='qemu'/>
Aug 15 06:51:27 user nova-compute[72803]:     </arch>
Aug 15 06:51:27 user nova-compute[72803]:     <features>
Aug 15 06:51:27 user nova-compute[72803]:       <cpuselection/>
Aug 15 06:51:27 user nova-compute[72803]:       <deviceboot/>
Aug 15 06:51:27 user nova-compute[72803]:       <disksnapshot default='on' toggle='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     </features>
Aug 15 06:51:27 user nova-compute[72803]:   </guest>
Aug 15 06:51:27 user nova-compute[72803]: </capabilities>
Aug 15 06:51:27 user nova-compute[72803]: 
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 06:51:27 user nova-compute[72803]: <domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 06:51:27 user nova-compute[72803]:   <domain>kvm</domain>
Aug 15 06:51:27 user nova-compute[72803]:   <machine>pc-q35-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:   <arch>i686</arch>
Aug 15 06:51:27 user nova-compute[72803]:   <vcpu max='288'/>
Aug 15 06:51:27 user nova-compute[72803]:   <iothreads supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:   <os supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='firmware'/>
Aug 15 06:51:27 user nova-compute[72803]:     <loader supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>rom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pflash</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='readonly'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='secure'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </loader>
Aug 15 06:51:27 user nova-compute[72803]:   </os>
Aug 15 06:51:27 user nova-compute[72803]:   <cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-passthrough' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='hostPassthroughMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='maximum' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='maximumMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-model' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='umip'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibpb'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibrs'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='erms'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='lm'/>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='custom' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>qemu64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>qemu32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>phenom</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>n270</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>kvm64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>coreduo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>core2duo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>athlon</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Westmere</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Snowridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Penryn</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G5</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G4</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G1</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Rome</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Milan</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Dhyana</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cooperlake</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Conroe</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>486</model>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:   </cpu>
Aug 15 06:51:27 user nova-compute[72803]:   <memoryBacking supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='sourceType'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>file</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>anonymous</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>memfd</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:   </memoryBacking>
Aug 15 06:51:27 user nova-compute[72803]:   <devices>
Aug 15 06:51:27 user nova-compute[72803]:     <disk supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='diskDevice'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>disk</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cdrom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>floppy</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>lun</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='bus'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>fdc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sata</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </disk>
Aug 15 06:51:27 user nova-compute[72803]:     <graphics supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sdl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vnc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>spice</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egl-headless</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </graphics>
Aug 15 06:51:27 user nova-compute[72803]:     <video supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='modelType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cirrus</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vmvga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>qxl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>none</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>bochs</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ramfb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </video>
Aug 15 06:51:27 user nova-compute[72803]:     <hostdev supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='mode'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>subsystem</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='startupPolicy'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>default</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>mandatory</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>requisite</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>optional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='subsysType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pci</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='capsType'/>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='pciBackend'/>
Aug 15 06:51:27 user nova-compute[72803]:     </hostdev>
Aug 15 06:51:27 user nova-compute[72803]:     <rng supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>random</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egd</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>builtin</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </rng>
Aug 15 06:51:27 user nova-compute[72803]:     <filesystem supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='driverType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>path</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>handle</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtiofs</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </filesystem>
Aug 15 06:51:27 user nova-compute[72803]:     <tpm supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-tis</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-crb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>passthrough</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>emulator</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </tpm>
Aug 15 06:51:27 user nova-compute[72803]:   </devices>
Aug 15 06:51:27 user nova-compute[72803]:   <features>
Aug 15 06:51:27 user nova-compute[72803]:     <gic supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <vmcoreinfo supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <genid supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backingStoreInput supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backup supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <sev supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:   </features>
Aug 15 06:51:27 user nova-compute[72803]: </domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 06:51:27 user nova-compute[72803]: <domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 06:51:27 user nova-compute[72803]:   <domain>kvm</domain>
Aug 15 06:51:27 user nova-compute[72803]:   <machine>pc-i440fx-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:   <arch>i686</arch>
Aug 15 06:51:27 user nova-compute[72803]:   <vcpu max='255'/>
Aug 15 06:51:27 user nova-compute[72803]:   <iothreads supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:   <os supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='firmware'/>
Aug 15 06:51:27 user nova-compute[72803]:     <loader supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>rom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pflash</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='readonly'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='secure'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </loader>
Aug 15 06:51:27 user nova-compute[72803]:   </os>
Aug 15 06:51:27 user nova-compute[72803]:   <cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-passthrough' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='hostPassthroughMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='maximum' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='maximumMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-model' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='umip'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibpb'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibrs'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='erms'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='lm'/>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='custom' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>qemu64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>qemu32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>phenom</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>n270</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>kvm64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>coreduo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>core2duo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>athlon</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Westmere</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Snowridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Penryn</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G5</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G4</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G1</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Rome</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Milan</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Dhyana</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cooperlake</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Conroe</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>486</model>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:   </cpu>
Aug 15 06:51:27 user nova-compute[72803]:   <memoryBacking supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='sourceType'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>file</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>anonymous</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>memfd</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:   </memoryBacking>
Aug 15 06:51:27 user nova-compute[72803]:   <devices>
Aug 15 06:51:27 user nova-compute[72803]:     <disk supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='diskDevice'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>disk</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cdrom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>floppy</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>lun</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='bus'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ide</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>fdc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sata</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </disk>
Aug 15 06:51:27 user nova-compute[72803]:     <graphics supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sdl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vnc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>spice</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egl-headless</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </graphics>
Aug 15 06:51:27 user nova-compute[72803]:     <video supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='modelType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cirrus</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vmvga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>qxl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>none</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>bochs</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ramfb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </video>
Aug 15 06:51:27 user nova-compute[72803]:     <hostdev supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='mode'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>subsystem</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='startupPolicy'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>default</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>mandatory</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>requisite</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>optional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='subsysType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pci</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='capsType'/>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='pciBackend'/>
Aug 15 06:51:27 user nova-compute[72803]:     </hostdev>
Aug 15 06:51:27 user nova-compute[72803]:     <rng supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>random</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egd</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>builtin</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </rng>
Aug 15 06:51:27 user nova-compute[72803]:     <filesystem supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='driverType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>path</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>handle</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtiofs</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </filesystem>
Aug 15 06:51:27 user nova-compute[72803]:     <tpm supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-tis</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-crb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>passthrough</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>emulator</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </tpm>
Aug 15 06:51:27 user nova-compute[72803]:   </devices>
Aug 15 06:51:27 user nova-compute[72803]:   <features>
Aug 15 06:51:27 user nova-compute[72803]:     <gic supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <vmcoreinfo supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <genid supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backingStoreInput supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backup supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <sev supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:   </features>
Aug 15 06:51:27 user nova-compute[72803]: </domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 06:51:27 user nova-compute[72803]: <domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 06:51:27 user nova-compute[72803]:   <domain>kvm</domain>
Aug 15 06:51:27 user nova-compute[72803]:   <machine>pc-q35-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:   <arch>i686</arch>
Aug 15 06:51:27 user nova-compute[72803]:   <vcpu max='288'/>
Aug 15 06:51:27 user nova-compute[72803]:   <iothreads supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:   <os supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='firmware'/>
Aug 15 06:51:27 user nova-compute[72803]:     <loader supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>rom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pflash</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='readonly'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='secure'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </loader>
Aug 15 06:51:27 user nova-compute[72803]:   </os>
Aug 15 06:51:27 user nova-compute[72803]:   <cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-passthrough' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='hostPassthroughMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='maximum' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='maximumMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-model' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='umip'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibpb'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibrs'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='erms'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='lm'/>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='custom' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>qemu64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>qemu32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>phenom</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>n270</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>kvm64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>coreduo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>core2duo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>athlon</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Westmere</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Snowridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Penryn</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G5</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G4</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G1</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Rome</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Milan</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Dhyana</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cooperlake</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Conroe</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>486</model>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:   </cpu>
Aug 15 06:51:27 user nova-compute[72803]:   <memoryBacking supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='sourceType'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>file</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>anonymous</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>memfd</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:   </memoryBacking>
Aug 15 06:51:27 user nova-compute[72803]:   <devices>
Aug 15 06:51:27 user nova-compute[72803]:     <disk supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='diskDevice'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>disk</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cdrom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>floppy</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>lun</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='bus'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>fdc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sata</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </disk>
Aug 15 06:51:27 user nova-compute[72803]:     <graphics supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sdl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vnc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>spice</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egl-headless</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </graphics>
Aug 15 06:51:27 user nova-compute[72803]:     <video supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='modelType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cirrus</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vmvga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>qxl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>none</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>bochs</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ramfb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </video>
Aug 15 06:51:27 user nova-compute[72803]:     <hostdev supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='mode'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>subsystem</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='startupPolicy'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>default</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>mandatory</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>requisite</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>optional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='subsysType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pci</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='capsType'/>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='pciBackend'/>
Aug 15 06:51:27 user nova-compute[72803]:     </hostdev>
Aug 15 06:51:27 user nova-compute[72803]:     <rng supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>random</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egd</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>builtin</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </rng>
Aug 15 06:51:27 user nova-compute[72803]:     <filesystem supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='driverType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>path</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>handle</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtiofs</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </filesystem>
Aug 15 06:51:27 user nova-compute[72803]:     <tpm supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-tis</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-crb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>passthrough</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>emulator</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </tpm>
Aug 15 06:51:27 user nova-compute[72803]:   </devices>
Aug 15 06:51:27 user nova-compute[72803]:   <features>
Aug 15 06:51:27 user nova-compute[72803]:     <gic supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <vmcoreinfo supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <genid supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backingStoreInput supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backup supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <sev supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:   </features>
Aug 15 06:51:27 user nova-compute[72803]: </domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 06:51:27 user nova-compute[72803]: <domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 06:51:27 user nova-compute[72803]:   <domain>kvm</domain>
Aug 15 06:51:27 user nova-compute[72803]:   <machine>pc-i440fx-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:   <arch>i686</arch>
Aug 15 06:51:27 user nova-compute[72803]:   <vcpu max='255'/>
Aug 15 06:51:27 user nova-compute[72803]:   <iothreads supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:   <os supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='firmware'/>
Aug 15 06:51:27 user nova-compute[72803]:     <loader supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>rom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pflash</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='readonly'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='secure'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </loader>
Aug 15 06:51:27 user nova-compute[72803]:   </os>
Aug 15 06:51:27 user nova-compute[72803]:   <cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-passthrough' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='hostPassthroughMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='maximum' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='maximumMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-model' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='umip'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibpb'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibrs'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='erms'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='lm'/>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='custom' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>qemu64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>qemu32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>phenom</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>n270</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>kvm64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>coreduo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>core2duo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>athlon</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Westmere</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Snowridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Penryn</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G5</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G4</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G1</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Rome</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Milan</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Dhyana</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cooperlake</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Conroe</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>486</model>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:   </cpu>
Aug 15 06:51:27 user nova-compute[72803]:   <memoryBacking supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='sourceType'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>file</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>anonymous</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>memfd</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:   </memoryBacking>
Aug 15 06:51:27 user nova-compute[72803]:   <devices>
Aug 15 06:51:27 user nova-compute[72803]:     <disk supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='diskDevice'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>disk</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cdrom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>floppy</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>lun</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='bus'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ide</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>fdc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sata</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </disk>
Aug 15 06:51:27 user nova-compute[72803]:     <graphics supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sdl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vnc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>spice</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egl-headless</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </graphics>
Aug 15 06:51:27 user nova-compute[72803]:     <video supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='modelType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cirrus</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vmvga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>qxl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>none</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>bochs</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ramfb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </video>
Aug 15 06:51:27 user nova-compute[72803]:     <hostdev supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='mode'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>subsystem</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='startupPolicy'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>default</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>mandatory</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>requisite</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>optional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='subsysType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pci</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='capsType'/>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='pciBackend'/>
Aug 15 06:51:27 user nova-compute[72803]:     </hostdev>
Aug 15 06:51:27 user nova-compute[72803]:     <rng supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>random</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egd</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>builtin</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </rng>
Aug 15 06:51:27 user nova-compute[72803]:     <filesystem supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='driverType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>path</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>handle</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtiofs</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </filesystem>
Aug 15 06:51:27 user nova-compute[72803]:     <tpm supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-tis</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-crb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>passthrough</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>emulator</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </tpm>
Aug 15 06:51:27 user nova-compute[72803]:   </devices>
Aug 15 06:51:27 user nova-compute[72803]:   <features>
Aug 15 06:51:27 user nova-compute[72803]:     <gic supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <vmcoreinfo supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <genid supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backingStoreInput supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backup supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <sev supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:   </features>
Aug 15 06:51:27 user nova-compute[72803]: </domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 06:51:27 user nova-compute[72803]: <domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 06:51:27 user nova-compute[72803]:   <domain>kvm</domain>
Aug 15 06:51:27 user nova-compute[72803]:   <machine>pc-q35-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:   <arch>x86_64</arch>
Aug 15 06:51:27 user nova-compute[72803]:   <vcpu max='288'/>
Aug 15 06:51:27 user nova-compute[72803]:   <iothreads supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:   <os supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='firmware'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>efi</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:     <loader supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>rom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pflash</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='readonly'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='secure'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </loader>
Aug 15 06:51:27 user nova-compute[72803]:   </os>
Aug 15 06:51:27 user nova-compute[72803]:   <cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-passthrough' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='hostPassthroughMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='maximum' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='maximumMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-model' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='umip'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='invtsc'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibpb'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibrs'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='rsba'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='erms'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='custom' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>qemu64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>qemu32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>phenom</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>n270</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>coreduo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>core2duo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>athlon</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Westmere</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Snowridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Penryn</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G5</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G4</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Opteron_G1</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Rome</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Milan</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Dhyana</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cooperlake</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Conroe</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>486</model>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:   </cpu>
Aug 15 06:51:27 user nova-compute[72803]:   <memoryBacking supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='sourceType'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>file</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>anonymous</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>memfd</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:   </memoryBacking>
Aug 15 06:51:27 user nova-compute[72803]:   <devices>
Aug 15 06:51:27 user nova-compute[72803]:     <disk supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='diskDevice'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>disk</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cdrom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>floppy</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>lun</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='bus'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>fdc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sata</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </disk>
Aug 15 06:51:27 user nova-compute[72803]:     <graphics supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sdl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vnc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>spice</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egl-headless</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </graphics>
Aug 15 06:51:27 user nova-compute[72803]:     <video supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='modelType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cirrus</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vmvga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>qxl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>none</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>bochs</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ramfb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </video>
Aug 15 06:51:27 user nova-compute[72803]:     <hostdev supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='mode'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>subsystem</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='startupPolicy'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>default</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>mandatory</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>requisite</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>optional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='subsysType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pci</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='capsType'/>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='pciBackend'/>
Aug 15 06:51:27 user nova-compute[72803]:     </hostdev>
Aug 15 06:51:27 user nova-compute[72803]:     <rng supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>random</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egd</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>builtin</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </rng>
Aug 15 06:51:27 user nova-compute[72803]:     <filesystem supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='driverType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>path</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>handle</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtiofs</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </filesystem>
Aug 15 06:51:27 user nova-compute[72803]:     <tpm supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-tis</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-crb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>passthrough</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>emulator</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </tpm>
Aug 15 06:51:27 user nova-compute[72803]:   </devices>
Aug 15 06:51:27 user nova-compute[72803]:   <features>
Aug 15 06:51:27 user nova-compute[72803]:     <gic supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <vmcoreinfo supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <genid supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backingStoreInput supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backup supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <sev supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:   </features>
Aug 15 06:51:27 user nova-compute[72803]: </domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 06:51:27 user nova-compute[72803]: <domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 06:51:27 user nova-compute[72803]:   <domain>kvm</domain>
Aug 15 06:51:27 user nova-compute[72803]:   <machine>pc-i440fx-jammy</machine>
Aug 15 06:51:27 user nova-compute[72803]:   <arch>x86_64</arch>
Aug 15 06:51:27 user nova-compute[72803]:   <vcpu max='255'/>
Aug 15 06:51:27 user nova-compute[72803]:   <iothreads supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:   <os supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='firmware'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>efi</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:     <loader supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>rom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pflash</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='readonly'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='secure'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </loader>
Aug 15 06:51:27 user nova-compute[72803]:   </os>
Aug 15 06:51:27 user nova-compute[72803]:   <cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-passthrough' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='hostPassthroughMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='maximum' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='maximumMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-model' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='umip'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='invtsc'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibpb'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibrs'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='rsba'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='erms'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='custom' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>qemu64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>qemu32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>phenom</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>n270</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>coreduo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>core2duo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>athlon</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Westmere</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Snowridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Penryn</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G5</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G4</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Opteron_G1</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Rome</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Milan</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Dhyana</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cooperlake</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Conroe</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>486</model>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:   </cpu>
Aug 15 06:51:27 user nova-compute[72803]:   <memoryBacking supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='sourceType'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>file</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>anonymous</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>memfd</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:   </memoryBacking>
Aug 15 06:51:27 user nova-compute[72803]:   <devices>
Aug 15 06:51:27 user nova-compute[72803]:     <disk supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='diskDevice'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>disk</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cdrom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>floppy</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>lun</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='bus'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ide</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>fdc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sata</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </disk>
Aug 15 06:51:27 user nova-compute[72803]:     <graphics supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sdl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vnc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>spice</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egl-headless</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </graphics>
Aug 15 06:51:27 user nova-compute[72803]:     <video supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='modelType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cirrus</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vmvga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>qxl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>none</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>bochs</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ramfb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </video>
Aug 15 06:51:27 user nova-compute[72803]:     <hostdev supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='mode'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>subsystem</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='startupPolicy'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>default</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>mandatory</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>requisite</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>optional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='subsysType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pci</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='capsType'/>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='pciBackend'/>
Aug 15 06:51:27 user nova-compute[72803]:     </hostdev>
Aug 15 06:51:27 user nova-compute[72803]:     <rng supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>random</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egd</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>builtin</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </rng>
Aug 15 06:51:27 user nova-compute[72803]:     <filesystem supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='driverType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>path</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>handle</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtiofs</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </filesystem>
Aug 15 06:51:27 user nova-compute[72803]:     <tpm supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-tis</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-crb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>passthrough</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>emulator</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </tpm>
Aug 15 06:51:27 user nova-compute[72803]:   </devices>
Aug 15 06:51:27 user nova-compute[72803]:   <features>
Aug 15 06:51:27 user nova-compute[72803]:     <gic supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <vmcoreinfo supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <genid supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backingStoreInput supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backup supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <sev supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:   </features>
Aug 15 06:51:27 user nova-compute[72803]: </domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 06:51:27 user nova-compute[72803]: <domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 06:51:27 user nova-compute[72803]:   <domain>kvm</domain>
Aug 15 06:51:27 user nova-compute[72803]:   <machine>pc-q35-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:   <arch>x86_64</arch>
Aug 15 06:51:27 user nova-compute[72803]:   <vcpu max='288'/>
Aug 15 06:51:27 user nova-compute[72803]:   <iothreads supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:   <os supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='firmware'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>efi</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:     <loader supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>rom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pflash</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='readonly'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='secure'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </loader>
Aug 15 06:51:27 user nova-compute[72803]:   </os>
Aug 15 06:51:27 user nova-compute[72803]:   <cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-passthrough' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='hostPassthroughMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='maximum' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='maximumMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-model' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='umip'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='invtsc'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibpb'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibrs'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='rsba'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='erms'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='custom' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>qemu64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>qemu32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>phenom</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>n270</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>coreduo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>core2duo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>athlon</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Westmere</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Snowridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Penryn</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G5</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G4</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Opteron_G1</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Rome</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Milan</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Dhyana</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cooperlake</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Conroe</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>486</model>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:   </cpu>
Aug 15 06:51:27 user nova-compute[72803]:   <memoryBacking supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='sourceType'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>file</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>anonymous</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>memfd</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:   </memoryBacking>
Aug 15 06:51:27 user nova-compute[72803]:   <devices>
Aug 15 06:51:27 user nova-compute[72803]:     <disk supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='diskDevice'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>disk</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cdrom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>floppy</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>lun</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='bus'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>fdc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sata</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </disk>
Aug 15 06:51:27 user nova-compute[72803]:     <graphics supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sdl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vnc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>spice</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egl-headless</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </graphics>
Aug 15 06:51:27 user nova-compute[72803]:     <video supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='modelType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cirrus</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vmvga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>qxl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>none</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>bochs</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ramfb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </video>
Aug 15 06:51:27 user nova-compute[72803]:     <hostdev supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='mode'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>subsystem</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='startupPolicy'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>default</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>mandatory</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>requisite</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>optional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='subsysType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pci</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='capsType'/>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='pciBackend'/>
Aug 15 06:51:27 user nova-compute[72803]:     </hostdev>
Aug 15 06:51:27 user nova-compute[72803]:     <rng supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>random</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egd</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>builtin</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </rng>
Aug 15 06:51:27 user nova-compute[72803]:     <filesystem supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='driverType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>path</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>handle</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtiofs</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </filesystem>
Aug 15 06:51:27 user nova-compute[72803]:     <tpm supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-tis</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-crb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>passthrough</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>emulator</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </tpm>
Aug 15 06:51:27 user nova-compute[72803]:   </devices>
Aug 15 06:51:27 user nova-compute[72803]:   <features>
Aug 15 06:51:27 user nova-compute[72803]:     <gic supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <vmcoreinfo supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <genid supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backingStoreInput supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backup supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <sev supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:   </features>
Aug 15 06:51:27 user nova-compute[72803]: </domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 06:51:27 user nova-compute[72803]: <domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 06:51:27 user nova-compute[72803]:   <domain>kvm</domain>
Aug 15 06:51:27 user nova-compute[72803]:   <machine>pc-i440fx-6.2</machine>
Aug 15 06:51:27 user nova-compute[72803]:   <arch>x86_64</arch>
Aug 15 06:51:27 user nova-compute[72803]:   <vcpu max='255'/>
Aug 15 06:51:27 user nova-compute[72803]:   <iothreads supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:   <os supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='firmware'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>efi</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:     <loader supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>rom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pflash</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='readonly'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>yes</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='secure'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>no</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </loader>
Aug 15 06:51:27 user nova-compute[72803]:   </os>
Aug 15 06:51:27 user nova-compute[72803]:   <cpu>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-passthrough' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='hostPassthroughMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='maximum' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='maximumMigratable'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>on</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>off</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='host-model' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <vendor>Intel</vendor>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ss'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='vmx'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pcid'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='hypervisor'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arat'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='umip'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='md-clear'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='invtsc'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibpb'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='ibrs'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-stibp'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='rsba'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='erms'/>
Aug 15 06:51:27 user nova-compute[72803]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:     <mode name='custom' supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>qemu64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>qemu32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>phenom</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>pentium</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>n270</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm64</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>kvm32</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>coreduo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>core2duo</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>athlon</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Westmere</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Snowridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Skylake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>SandyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Penryn</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G5</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G4</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G3</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Opteron_G2</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Opteron_G1</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>IvyBridge</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Icelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Haswell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Rome</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-Milan</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>EPYC</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Dhyana</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cooperlake</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>Conroe</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='no'>Broadwell</model>
Aug 15 06:51:27 user nova-compute[72803]:       <model usable='yes'>486</model>
Aug 15 06:51:27 user nova-compute[72803]:     </mode>
Aug 15 06:51:27 user nova-compute[72803]:   </cpu>
Aug 15 06:51:27 user nova-compute[72803]:   <memoryBacking supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:     <enum name='sourceType'>
Aug 15 06:51:27 user nova-compute[72803]:       <value>file</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>anonymous</value>
Aug 15 06:51:27 user nova-compute[72803]:       <value>memfd</value>
Aug 15 06:51:27 user nova-compute[72803]:     </enum>
Aug 15 06:51:27 user nova-compute[72803]:   </memoryBacking>
Aug 15 06:51:27 user nova-compute[72803]:   <devices>
Aug 15 06:51:27 user nova-compute[72803]:     <disk supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='diskDevice'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>disk</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cdrom</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>floppy</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>lun</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='bus'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ide</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>fdc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sata</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </disk>
Aug 15 06:51:27 user nova-compute[72803]:     <graphics supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='type'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>sdl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vnc</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>spice</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egl-headless</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </graphics>
Aug 15 06:51:27 user nova-compute[72803]:     <video supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='modelType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>cirrus</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>vmvga</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>qxl</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>none</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>bochs</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>ramfb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </video>
Aug 15 06:51:27 user nova-compute[72803]:     <hostdev supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='mode'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>subsystem</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='startupPolicy'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>default</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>mandatory</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>requisite</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>optional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='subsysType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>usb</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>pci</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>scsi</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='capsType'/>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='pciBackend'/>
Aug 15 06:51:27 user nova-compute[72803]:     </hostdev>
Aug 15 06:51:27 user nova-compute[72803]:     <rng supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtio-non-transitional</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>random</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>egd</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>builtin</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </rng>
Aug 15 06:51:27 user nova-compute[72803]:     <filesystem supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='driverType'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>path</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>handle</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>virtiofs</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </filesystem>
Aug 15 06:51:27 user nova-compute[72803]:     <tpm supported='yes'>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='model'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-tis</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>tpm-crb</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:       <enum name='backendModel'>
Aug 15 06:51:27 user nova-compute[72803]:         <value>passthrough</value>
Aug 15 06:51:27 user nova-compute[72803]:         <value>emulator</value>
Aug 15 06:51:27 user nova-compute[72803]:       </enum>
Aug 15 06:51:27 user nova-compute[72803]:     </tpm>
Aug 15 06:51:27 user nova-compute[72803]:   </devices>
Aug 15 06:51:27 user nova-compute[72803]:   <features>
Aug 15 06:51:27 user nova-compute[72803]:     <gic supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:     <vmcoreinfo supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <genid supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backingStoreInput supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <backup supported='yes'/>
Aug 15 06:51:27 user nova-compute[72803]:     <sev supported='no'/>
Aug 15 06:51:27 user nova-compute[72803]:   </features>
Aug 15 06:51:27 user nova-compute[72803]: </domainCapabilities>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72803) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72803) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Checking secure boot support for host arch (x86_64) {{(pid=72803) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 06:51:27 user nova-compute[72803]: INFO nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Secure Boot support detected
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] cpu compare xml: <cpu match="exact">
Aug 15 06:51:27 user nova-compute[72803]:   <model>Nehalem</model>
Aug 15 06:51:27 user nova-compute[72803]: </cpu>
Aug 15 06:51:27 user nova-compute[72803]:  {{(pid=72803) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 06:51:27 user nova-compute[72803]: INFO nova.virt.node [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Generated node identity 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c
Aug 15 06:51:27 user nova-compute[72803]: INFO nova.virt.node [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Wrote node identity 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c to /opt/stack/data/nova/compute_id
Aug 15 06:51:27 user nova-compute[72803]: WARNING nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Compute nodes ['6051aed2-f8f0-45e9-ae6c-41afa9d24b7c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 06:51:27 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 06:51:27 user nova-compute[72803]: WARNING nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 06:51:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:51:27 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:51:27 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:51:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Hypervisor/Node resource view: name=user free_ram=10923MB free_disk=26.377887725830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:51:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:51:27 user nova-compute[72803]: WARNING nova.compute.resource_tracker [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] No compute node record for user:6051aed2-f8f0-45e9-ae6c-41afa9d24b7c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c could not be found.
Aug 15 06:51:28 user nova-compute[72803]: INFO nova.compute.resource_tracker [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Compute node record created for user:user with uuid: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:51:28 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [req-c36d8353-7325-4b5e-a431-1a6b9e243229] Created resource provider record via placement API for resource provider with UUID 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c and name user.
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72803) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 06:51:28 user nova-compute[72803]: INFO nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] kernel doesn't support AMD SEV
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Libvirt baseline CPU <cpu>
Aug 15 06:51:28 user nova-compute[72803]:   <arch>x86_64</arch>
Aug 15 06:51:28 user nova-compute[72803]:   <model>Nehalem</model>
Aug 15 06:51:28 user nova-compute[72803]:   <vendor>Intel</vendor>
Aug 15 06:51:28 user nova-compute[72803]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 06:51:28 user nova-compute[72803]: </cpu>
Aug 15 06:51:28 user nova-compute[72803]:  {{(pid=72803) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Updated inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Updating resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c generation from 0 to 1 during operation: update_inventory {{(pid=72803) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Updating resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c generation from 1 to 2 during operation: update_traits {{(pid=72803) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.service [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Creating RPC server for service compute {{(pid=72803) start /opt/stack/nova/nova/service.py:182}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.service [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Join ServiceGroup membership for this service compute {{(pid=72803) start /opt/stack/nova/nova/service.py:199}}
Aug 15 06:51:28 user nova-compute[72803]: DEBUG nova.servicegroup.drivers.db [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72803) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 06:51:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_power_states {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:51:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:52:19 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:52:19 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=10327MB free_disk=26.281600952148438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:52:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:53:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:53:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:53:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=10247MB free_disk=26.316184997558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:53:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:54:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:54:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:54:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:54:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:54:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:54:23 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:54:23 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:54:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=10223MB free_disk=26.11175537109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:54:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:55:22 user nova-compute[72803]: INFO nova.compute.claims [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Claim successful on node user
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:55:23 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Skipping network cache update for instance because it is Building. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:55:23 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Creating image(s)
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "/opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "/opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "/opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:23 user nova-compute[72803]: DEBUG nova.policy [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc7ee5090ba54d4b8acbd4c9f84835f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ede5bd5cb24059bc4a185badef865d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718.part --force-share --output=json" returned: 0 in 0.401s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG nova.virt.images [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] 058dab3c-04e2-4357-a904-efeb3f5412a5 was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718.part /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:24 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:24 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:24 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=9424MB free_disk=26.094104766845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718.part /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718.converted" returned: 0 in 0.147s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.607s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:25 user nova-compute[72803]: INFO oslo.privsep.daemon [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfplm1yo2/privsep.sock']
Aug 15 06:55:25 user sudo[82249]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfplm1yo2/privsep.sock
Aug 15 06:55:25 user sudo[82249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 06:55:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:55:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Successfully created port: 776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:55:27 user sudo[82249]: pam_unix(sudo:session): session closed for user root
Aug 15 06:55:27 user nova-compute[72803]: INFO oslo.privsep.daemon [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Spawned new privsep daemon via rootwrap
Aug 15 06:55:27 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 06:55:27 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 06:55:27 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 06:55:27 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82254
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk 1073741824" returned: 0 in 0.046s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.157s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Cannot resize image /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG nova.objects.instance [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'migration_context' on Instance uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Ensure instance console log exists: /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Successfully updated port: 776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:55:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:55:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquired lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:55:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:55:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:55:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-af063948-9ec0-464e-896d-e97552876086 req-64aeda03-b147-4f00-af60-77e0486dff4f service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received event network-changed-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:55:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-af063948-9ec0-464e-896d-e97552876086 req-64aeda03-b147-4f00-af60-77e0486dff4f service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Refreshing instance network info cache due to event network-changed-776d1973-187f-449d-befe-e6780ba387d7. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:55:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-af063948-9ec0-464e-896d-e97552876086 req-64aeda03-b147-4f00-af60-77e0486dff4f service nova] Acquiring lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updating instance_info_cache with network_info: [{"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Releasing lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Instance network_info: |[{"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-af063948-9ec0-464e-896d-e97552876086 req-64aeda03-b147-4f00-af60-77e0486dff4f service nova] Acquired lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-af063948-9ec0-464e-896d-e97552876086 req-64aeda03-b147-4f00-af60-77e0486dff4f service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Refreshing network info cache for port 776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Start _get_guest_xml network_info=[{"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:55:30 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:30 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-121904816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-121904816',id=1,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-flp1s0j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:55:24Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=4074dae9-9d30-4b2a-b0c3-58e57088e4bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=776d1973-187f-449d-befe-e6780ba387d7,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap776d1973-18') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.objects.instance [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'pci_devices' on Instance uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:55:30 user nova-compute[72803]:   <uuid>4074dae9-9d30-4b2a-b0c3-58e57088e4bd</uuid>
Aug 15 06:55:30 user nova-compute[72803]:   <name>instance-00000001</name>
Aug 15 06:55:30 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:55:30 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:55:30 user nova-compute[72803]:   <metadata>
Aug 15 06:55:30 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:55:30 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:55:30 user nova-compute[72803]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-121904816</nova:name>
Aug 15 06:55:30 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:55:30</nova:creationTime>
Aug 15 06:55:30 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:55:30 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:55:30 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:55:30 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:55:30 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:55:30 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:55:30 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:55:30 user nova-compute[72803]:       <nova:owner>
Aug 15 06:55:30 user nova-compute[72803]:         <nova:user uuid="bc7ee5090ba54d4b8acbd4c9f84835f3">tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member</nova:user>
Aug 15 06:55:30 user nova-compute[72803]:         <nova:project uuid="07ede5bd5cb24059bc4a185badef865d">tempest-ServerBootFromVolumeStableRescueTest-1860507335</nova:project>
Aug 15 06:55:30 user nova-compute[72803]:       </nova:owner>
Aug 15 06:55:30 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:55:30 user nova-compute[72803]:       <nova:ports>
Aug 15 06:55:30 user nova-compute[72803]:         <nova:port uuid="776d1973-187f-449d-befe-e6780ba387d7">
Aug 15 06:55:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 06:55:30 user nova-compute[72803]:         </nova:port>
Aug 15 06:55:30 user nova-compute[72803]:       </nova:ports>
Aug 15 06:55:30 user nova-compute[72803]:     </nova:instance>
Aug 15 06:55:30 user nova-compute[72803]:   </metadata>
Aug 15 06:55:30 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:55:30 user nova-compute[72803]:     <system>
Aug 15 06:55:30 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:55:30 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:55:30 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:55:30 user nova-compute[72803]:       <entry name="serial">4074dae9-9d30-4b2a-b0c3-58e57088e4bd</entry>
Aug 15 06:55:30 user nova-compute[72803]:       <entry name="uuid">4074dae9-9d30-4b2a-b0c3-58e57088e4bd</entry>
Aug 15 06:55:30 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:55:30 user nova-compute[72803]:     </system>
Aug 15 06:55:30 user nova-compute[72803]:   </sysinfo>
Aug 15 06:55:30 user nova-compute[72803]:   <os>
Aug 15 06:55:30 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:55:30 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:55:30 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:55:30 user nova-compute[72803]:   </os>
Aug 15 06:55:30 user nova-compute[72803]:   <features>
Aug 15 06:55:30 user nova-compute[72803]:     <acpi/>
Aug 15 06:55:30 user nova-compute[72803]:     <apic/>
Aug 15 06:55:30 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:55:30 user nova-compute[72803]:   </features>
Aug 15 06:55:30 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:55:30 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:55:30 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:55:30 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:55:30 user nova-compute[72803]:   </clock>
Aug 15 06:55:30 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:55:30 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:55:30 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:55:30 user nova-compute[72803]:   </cpu>
Aug 15 06:55:30 user nova-compute[72803]:   <devices>
Aug 15 06:55:30 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:55:30 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:55:30 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk"/>
Aug 15 06:55:30 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:55:30 user nova-compute[72803]:     </disk>
Aug 15 06:55:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:55:30 user nova-compute[72803]:       <mac address="fa:16:3e:fb:04:84"/>
Aug 15 06:55:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:55:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:55:30 user nova-compute[72803]:       <target dev="tap776d1973-18"/>
Aug 15 06:55:30 user nova-compute[72803]:     </interface>
Aug 15 06:55:30 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:55:30 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/console.log" append="off"/>
Aug 15 06:55:30 user nova-compute[72803]:     </serial>
Aug 15 06:55:30 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:55:30 user nova-compute[72803]:     <video>
Aug 15 06:55:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:55:30 user nova-compute[72803]:     </video>
Aug 15 06:55:30 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:55:30 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:55:30 user nova-compute[72803]:     </rng>
Aug 15 06:55:30 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:55:30 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:55:30 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:55:30 user nova-compute[72803]:     </memballoon>
Aug 15 06:55:30 user nova-compute[72803]:   </devices>
Aug 15 06:55:30 user nova-compute[72803]: </domain>
Aug 15 06:55:30 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-121904816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-121904816',id=1,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-flp1s0j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:55:24Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=4074dae9-9d30-4b2a-b0c3-58e57088e4bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=776d1973-187f-449d-befe-e6780ba387d7,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap776d1973-18') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG os_vif [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=776d1973-187f-449d-befe-e6780ba387d7,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap776d1973-18') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Created schema index Interface.name {{(pid=72803) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Created schema index Port.name {{(pid=72803) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Created schema index Bridge.name {{(pid=72803) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [POLLOUT] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:55:30 user nova-compute[72803]: INFO oslo.privsep.daemon [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpu8f7pqi6/privsep.sock']
Aug 15 06:55:30 user sudo[82323]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpu8f7pqi6/privsep.sock
Aug 15 06:55:30 user sudo[82323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 06:55:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:31 user nova-compute[72803]: DEBUG nova.network.neutron [req-af063948-9ec0-464e-896d-e97552876086 req-64aeda03-b147-4f00-af60-77e0486dff4f service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updated VIF entry in instance network info cache for port 776d1973-187f-449d-befe-e6780ba387d7. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:55:31 user nova-compute[72803]: DEBUG nova.network.neutron [req-af063948-9ec0-464e-896d-e97552876086 req-64aeda03-b147-4f00-af60-77e0486dff4f service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updating instance_info_cache with network_info: [{"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:55:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-af063948-9ec0-464e-896d-e97552876086 req-64aeda03-b147-4f00-af60-77e0486dff4f service nova] Releasing lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:55:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:32 user sudo[82323]: pam_unix(sudo:session): session closed for user root
Aug 15 06:55:32 user nova-compute[72803]: INFO oslo.privsep.daemon [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Spawned new privsep daemon via rootwrap
Aug 15 06:55:32 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 06:55:32 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 06:55:32 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 06:55:32 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82326
Aug 15 06:55:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap776d1973-18, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap776d1973-18, col_values=(('external_ids', {'iface-id': '776d1973-187f-449d-befe-e6780ba387d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:04:84', 'vm-uuid': '4074dae9-9d30-4b2a-b0c3-58e57088e4bd'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:55:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:33 user nova-compute[72803]: INFO os_vif [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=776d1973-187f-449d-befe-e6780ba387d7,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap776d1973-18')
Aug 15 06:55:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:55:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No VIF found with MAC fa:16:3e:fb:04:84, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:55:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082536.2689483, 4074dae9-9d30-4b2a-b0c3-58e57088e4bd => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:55:36 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] VM Resumed (Lifecycle Event)
Aug 15 06:55:36 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Instance spawned successfully.
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:55:36 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082536.2690775, 4074dae9-9d30-4b2a-b0c3-58e57088e4bd => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:55:36 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] VM Started (Lifecycle Event)
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:55:36 user nova-compute[72803]: INFO nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Took 12.89 seconds to spawn the instance on the hypervisor.
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:36 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:55:36 user nova-compute[72803]: INFO nova.compute.manager [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Took 13.89 seconds to build instance.
Aug 15 06:55:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fb489138-d26a-4911-8d1e-235b4687a103 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.244s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:36 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:55:36 user nova-compute[72803]: INFO nova.compute.claims [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Claim successful on node user
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:55:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:55:37 user nova-compute[72803]: INFO nova.compute.claims [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Claim successful on node user
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:55:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Creating image(s)
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.policy [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35a29bfde8d746f9b15c12e31a925c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7937188c3cb441fa4f4348d2e3b2573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:55:37 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.210s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:55:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:55:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.238s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "0777bcb5-966e-424a-8732-e53c6352183e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk 1073741824" returned: 0 in 0.084s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:55:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Creating image(s)
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "/opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "/opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.policy [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50b2d95238654df88548e1549fa73210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3743fde3d93f4fed84b52926dadc07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.239s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:55:38 user nova-compute[72803]: INFO nova.compute.claims [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Claim successful on node user
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.233s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Cannot resize image /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'migration_context' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Ensure instance console log exists: /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.233s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk 1073741824" returned: 0 in 0.051s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:55:39 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:55:39 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Creating image(s)
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "/opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "/opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "/opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Cannot resize image /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.objects.instance [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'migration_context' on Instance uuid ff252c72-caf0-4c90-b078-6aab5a0b1fab {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Ensure instance console log exists: /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.203s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG nova.policy [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1e4fd69d1a64b8d80b0d1a45d62190f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaf763674bc4aaca9e52eda0cf41f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk 1073741824" returned: 0 in 0.113s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Cannot resize image /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG nova.objects.instance [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'migration_context' on Instance uuid 0777bcb5-966e-424a-8732-e53c6352183e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Ensure instance console log exists: /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:41 user nova-compute[72803]: DEBUG nova.network.neutron [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Successfully created port: 5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:55:41 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Successfully created port: 01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:55:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:43 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Successfully created port: d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:55:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Successfully updated port: 01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:55:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:55:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquired lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:55:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:55:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-87db962f-ac25-4e8a-983b-23f6015baef5 req-e38e4564-0c15-4762-b31e-7680b43c7657 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-changed-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:55:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-87db962f-ac25-4e8a-983b-23f6015baef5 req-e38e4564-0c15-4762-b31e-7680b43c7657 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Refreshing instance network info cache due to event network-changed-01af57c9-c09e-45b8-8ba5-c90a6c729ec9. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:55:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-87db962f-ac25-4e8a-983b-23f6015baef5 req-e38e4564-0c15-4762-b31e-7680b43c7657 service nova] Acquiring lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:55:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Releasing lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance network_info: |[{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-87db962f-ac25-4e8a-983b-23f6015baef5 req-e38e4564-0c15-4762-b31e-7680b43c7657 service nova] Acquired lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.neutron [req-87db962f-ac25-4e8a-983b-23f6015baef5 req-e38e4564-0c15-4762-b31e-7680b43c7657 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Refreshing network info cache for port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Start _get_guest_xml network_info=[{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:55:46 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:46 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1152789104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1152789104',id=2,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyuK0T+jZdeRbyAIRejk7h3Ml+YmKlkGNdFeM7qM3Ug6lUIK5jXhgYrxd4X/ihahxzn/CahnDI1epyjgQifpsf5mhRksc8sd/Cf/kMl3QRRbB6UOkZUEN18an3vjOJoQw==',key_name='tempest-keypair-577174082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-11vl8r1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=454ea345-aaa5-423b-add3-20a933978eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'pci_devices' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:55:46 user nova-compute[72803]:   <uuid>454ea345-aaa5-423b-add3-20a933978eec</uuid>
Aug 15 06:55:46 user nova-compute[72803]:   <name>instance-00000002</name>
Aug 15 06:55:46 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:55:46 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:55:46 user nova-compute[72803]:   <metadata>
Aug 15 06:55:46 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:55:46 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:55:46 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1152789104</nova:name>
Aug 15 06:55:46 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:55:46</nova:creationTime>
Aug 15 06:55:46 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:55:46 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:55:46 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:55:46 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:55:46 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:55:46 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:55:46 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:55:46 user nova-compute[72803]:       <nova:owner>
Aug 15 06:55:46 user nova-compute[72803]:         <nova:user uuid="35a29bfde8d746f9b15c12e31a925c47">tempest-AttachVolumeShelveTestJSON-758519316-project-member</nova:user>
Aug 15 06:55:46 user nova-compute[72803]:         <nova:project uuid="f7937188c3cb441fa4f4348d2e3b2573">tempest-AttachVolumeShelveTestJSON-758519316</nova:project>
Aug 15 06:55:46 user nova-compute[72803]:       </nova:owner>
Aug 15 06:55:46 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:55:46 user nova-compute[72803]:       <nova:ports>
Aug 15 06:55:46 user nova-compute[72803]:         <nova:port uuid="01af57c9-c09e-45b8-8ba5-c90a6c729ec9">
Aug 15 06:55:46 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 06:55:46 user nova-compute[72803]:         </nova:port>
Aug 15 06:55:46 user nova-compute[72803]:       </nova:ports>
Aug 15 06:55:46 user nova-compute[72803]:     </nova:instance>
Aug 15 06:55:46 user nova-compute[72803]:   </metadata>
Aug 15 06:55:46 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:55:46 user nova-compute[72803]:     <system>
Aug 15 06:55:46 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:55:46 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:55:46 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:55:46 user nova-compute[72803]:       <entry name="serial">454ea345-aaa5-423b-add3-20a933978eec</entry>
Aug 15 06:55:46 user nova-compute[72803]:       <entry name="uuid">454ea345-aaa5-423b-add3-20a933978eec</entry>
Aug 15 06:55:46 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:55:46 user nova-compute[72803]:     </system>
Aug 15 06:55:46 user nova-compute[72803]:   </sysinfo>
Aug 15 06:55:46 user nova-compute[72803]:   <os>
Aug 15 06:55:46 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:55:46 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:55:46 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:55:46 user nova-compute[72803]:   </os>
Aug 15 06:55:46 user nova-compute[72803]:   <features>
Aug 15 06:55:46 user nova-compute[72803]:     <acpi/>
Aug 15 06:55:46 user nova-compute[72803]:     <apic/>
Aug 15 06:55:46 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:55:46 user nova-compute[72803]:   </features>
Aug 15 06:55:46 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:55:46 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:55:46 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:55:46 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:55:46 user nova-compute[72803]:   </clock>
Aug 15 06:55:46 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:55:46 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:55:46 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:55:46 user nova-compute[72803]:   </cpu>
Aug 15 06:55:46 user nova-compute[72803]:   <devices>
Aug 15 06:55:46 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:55:46 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:55:46 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk"/>
Aug 15 06:55:46 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:55:46 user nova-compute[72803]:     </disk>
Aug 15 06:55:46 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:55:46 user nova-compute[72803]:       <mac address="fa:16:3e:47:dd:5e"/>
Aug 15 06:55:46 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:55:46 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:55:46 user nova-compute[72803]:       <target dev="tap01af57c9-c0"/>
Aug 15 06:55:46 user nova-compute[72803]:     </interface>
Aug 15 06:55:46 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:55:46 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/console.log" append="off"/>
Aug 15 06:55:46 user nova-compute[72803]:     </serial>
Aug 15 06:55:46 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:55:46 user nova-compute[72803]:     <video>
Aug 15 06:55:46 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:55:46 user nova-compute[72803]:     </video>
Aug 15 06:55:46 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:55:46 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:55:46 user nova-compute[72803]:     </rng>
Aug 15 06:55:46 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:55:46 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:55:46 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:55:46 user nova-compute[72803]:     </memballoon>
Aug 15 06:55:46 user nova-compute[72803]:   </devices>
Aug 15 06:55:46 user nova-compute[72803]: </domain>
Aug 15 06:55:46 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1152789104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1152789104',id=2,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyuK0T+jZdeRbyAIRejk7h3Ml+YmKlkGNdFeM7qM3Ug6lUIK5jXhgYrxd4X/ihahxzn/CahnDI1epyjgQifpsf5mhRksc8sd/Cf/kMl3QRRbB6UOkZUEN18an3vjOJoQw==',key_name='tempest-keypair-577174082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-11vl8r1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=454ea345-aaa5-423b-add3-20a933978eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG os_vif [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01af57c9-c0, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01af57c9-c0, col_values=(('external_ids', {'iface-id': '01af57c9-c09e-45b8-8ba5-c90a6c729ec9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:dd:5e', 'vm-uuid': '454ea345-aaa5-423b-add3-20a933978eec'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:46 user nova-compute[72803]: INFO os_vif [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0')
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No VIF found with MAC fa:16:3e:47:dd:5e, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.neutron [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Successfully updated port: 5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquired lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.neutron [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.network.neutron [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-745a710b-79b6-4217-9dc9-f96ddf25ad98 req-e592d424-e95c-474b-b222-5f5675326e07 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received event network-changed-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-745a710b-79b6-4217-9dc9-f96ddf25ad98 req-e592d424-e95c-474b-b222-5f5675326e07 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Refreshing instance network info cache due to event network-changed-5248eb08-f20c-4c7e-889e-959facbbc988. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:55:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-745a710b-79b6-4217-9dc9-f96ddf25ad98 req-e592d424-e95c-474b-b222-5f5675326e07 service nova] Acquiring lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:55:47 user nova-compute[72803]: DEBUG nova.network.neutron [req-87db962f-ac25-4e8a-983b-23f6015baef5 req-e38e4564-0c15-4762-b31e-7680b43c7657 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updated VIF entry in instance network info cache for port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:55:47 user nova-compute[72803]: DEBUG nova.network.neutron [req-87db962f-ac25-4e8a-983b-23f6015baef5 req-e38e4564-0c15-4762-b31e-7680b43c7657 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:55:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-87db962f-ac25-4e8a-983b-23f6015baef5 req-e38e4564-0c15-4762-b31e-7680b43c7657 service nova] Releasing lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:55:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Successfully updated port: d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquired lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.neutron [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updating instance_info_cache with network_info: [{"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Releasing lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Instance network_info: |[{"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-745a710b-79b6-4217-9dc9-f96ddf25ad98 req-e592d424-e95c-474b-b222-5f5675326e07 service nova] Acquired lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.neutron [req-745a710b-79b6-4217-9dc9-f96ddf25ad98 req-e592d424-e95c-474b-b222-5f5675326e07 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Refreshing network info cache for port 5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Start _get_guest_xml network_info=[{"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:55:48 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:48 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-122733738',display_name='tempest-AttachVolumeNegativeTest-server-122733738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-122733738',id=3,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU/IpZeRPR3dfkhJ1fJln7PRIyHNDlD5k0XgYt/y2L0Lf18crCbTcIEiBtUvnRbSPpmOg2TQ2tjSdD1Q3jIdsEtGTZyB2BkvZ3o6bJJUiyrz52dySc/onHk1zAZs5kDzA==',key_name='tempest-keypair-1082670762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-0kn80jqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=ff252c72-caf0-4c90-b078-6aab5a0b1fab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7a:93,bridge_name='br-int',has_traffic_filtering=True,id=5248eb08-f20c-4c7e-889e-959facbbc988,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5248eb08-f2') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.objects.instance [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'pci_devices' on Instance uuid ff252c72-caf0-4c90-b078-6aab5a0b1fab {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:55:48 user nova-compute[72803]:   <uuid>ff252c72-caf0-4c90-b078-6aab5a0b1fab</uuid>
Aug 15 06:55:48 user nova-compute[72803]:   <name>instance-00000003</name>
Aug 15 06:55:48 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:55:48 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:55:48 user nova-compute[72803]:   <metadata>
Aug 15 06:55:48 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:55:48 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:55:48 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeNegativeTest-server-122733738</nova:name>
Aug 15 06:55:48 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:55:48</nova:creationTime>
Aug 15 06:55:48 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:55:48 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:55:48 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:55:48 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:55:48 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:55:48 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:55:48 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:55:48 user nova-compute[72803]:       <nova:owner>
Aug 15 06:55:48 user nova-compute[72803]:         <nova:user uuid="50b2d95238654df88548e1549fa73210">tempest-AttachVolumeNegativeTest-37766204-project-member</nova:user>
Aug 15 06:55:48 user nova-compute[72803]:         <nova:project uuid="3743fde3d93f4fed84b52926dadc07f7">tempest-AttachVolumeNegativeTest-37766204</nova:project>
Aug 15 06:55:48 user nova-compute[72803]:       </nova:owner>
Aug 15 06:55:48 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:55:48 user nova-compute[72803]:       <nova:ports>
Aug 15 06:55:48 user nova-compute[72803]:         <nova:port uuid="5248eb08-f20c-4c7e-889e-959facbbc988">
Aug 15 06:55:48 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 06:55:48 user nova-compute[72803]:         </nova:port>
Aug 15 06:55:48 user nova-compute[72803]:       </nova:ports>
Aug 15 06:55:48 user nova-compute[72803]:     </nova:instance>
Aug 15 06:55:48 user nova-compute[72803]:   </metadata>
Aug 15 06:55:48 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:55:48 user nova-compute[72803]:     <system>
Aug 15 06:55:48 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:55:48 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:55:48 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:55:48 user nova-compute[72803]:       <entry name="serial">ff252c72-caf0-4c90-b078-6aab5a0b1fab</entry>
Aug 15 06:55:48 user nova-compute[72803]:       <entry name="uuid">ff252c72-caf0-4c90-b078-6aab5a0b1fab</entry>
Aug 15 06:55:48 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:55:48 user nova-compute[72803]:     </system>
Aug 15 06:55:48 user nova-compute[72803]:   </sysinfo>
Aug 15 06:55:48 user nova-compute[72803]:   <os>
Aug 15 06:55:48 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:55:48 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:55:48 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:55:48 user nova-compute[72803]:   </os>
Aug 15 06:55:48 user nova-compute[72803]:   <features>
Aug 15 06:55:48 user nova-compute[72803]:     <acpi/>
Aug 15 06:55:48 user nova-compute[72803]:     <apic/>
Aug 15 06:55:48 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:55:48 user nova-compute[72803]:   </features>
Aug 15 06:55:48 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:55:48 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:55:48 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:55:48 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:55:48 user nova-compute[72803]:   </clock>
Aug 15 06:55:48 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:55:48 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:55:48 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:55:48 user nova-compute[72803]:   </cpu>
Aug 15 06:55:48 user nova-compute[72803]:   <devices>
Aug 15 06:55:48 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:55:48 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:55:48 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk"/>
Aug 15 06:55:48 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:55:48 user nova-compute[72803]:     </disk>
Aug 15 06:55:48 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:55:48 user nova-compute[72803]:       <mac address="fa:16:3e:3d:7a:93"/>
Aug 15 06:55:48 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:55:48 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:55:48 user nova-compute[72803]:       <target dev="tap5248eb08-f2"/>
Aug 15 06:55:48 user nova-compute[72803]:     </interface>
Aug 15 06:55:48 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:55:48 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/console.log" append="off"/>
Aug 15 06:55:48 user nova-compute[72803]:     </serial>
Aug 15 06:55:48 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:55:48 user nova-compute[72803]:     <video>
Aug 15 06:55:48 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:55:48 user nova-compute[72803]:     </video>
Aug 15 06:55:48 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:55:48 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:55:48 user nova-compute[72803]:     </rng>
Aug 15 06:55:48 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:55:48 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:55:48 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:55:48 user nova-compute[72803]:     </memballoon>
Aug 15 06:55:48 user nova-compute[72803]:   </devices>
Aug 15 06:55:48 user nova-compute[72803]: </domain>
Aug 15 06:55:48 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-122733738',display_name='tempest-AttachVolumeNegativeTest-server-122733738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-122733738',id=3,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU/IpZeRPR3dfkhJ1fJln7PRIyHNDlD5k0XgYt/y2L0Lf18crCbTcIEiBtUvnRbSPpmOg2TQ2tjSdD1Q3jIdsEtGTZyB2BkvZ3o6bJJUiyrz52dySc/onHk1zAZs5kDzA==',key_name='tempest-keypair-1082670762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-0kn80jqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=ff252c72-caf0-4c90-b078-6aab5a0b1fab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7a:93,bridge_name='br-int',has_traffic_filtering=True,id=5248eb08-f20c-4c7e-889e-959facbbc988,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5248eb08-f2') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG os_vif [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7a:93,bridge_name='br-int',has_traffic_filtering=True,id=5248eb08-f20c-4c7e-889e-959facbbc988,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5248eb08-f2') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5248eb08-f2, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5248eb08-f2, col_values=(('external_ids', {'iface-id': '5248eb08-f20c-4c7e-889e-959facbbc988', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:7a:93', 'vm-uuid': 'ff252c72-caf0-4c90-b078-6aab5a0b1fab'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:48 user nova-compute[72803]: INFO os_vif [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:7a:93,bridge_name='br-int',has_traffic_filtering=True,id=5248eb08-f20c-4c7e-889e-959facbbc988,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5248eb08-f2')
Aug 15 06:55:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:55:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No VIF found with MAC fa:16:3e:3d:7a:93, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:55:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-798bce13-a6b5-4be7-86d0-144ba69e3210 req-77657109-4d87-44a2-bd33-797cb073768f service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-changed-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:55:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-798bce13-a6b5-4be7-86d0-144ba69e3210 req-77657109-4d87-44a2-bd33-797cb073768f service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Refreshing instance network info cache due to event network-changed-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:55:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-798bce13-a6b5-4be7-86d0-144ba69e3210 req-77657109-4d87-44a2-bd33-797cb073768f service nova] Acquiring lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:55:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082550.2035177, 454ea345-aaa5-423b-add3-20a933978eec => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:55:50 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] VM Resumed (Lifecycle Event)
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:55:50 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance spawned successfully.
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:50 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082550.2052057, 454ea345-aaa5-423b-add3-20a933978eec => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:55:50 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] VM Started (Lifecycle Event)
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:55:50 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:55:50 user nova-compute[72803]: INFO nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Took 12.56 seconds to spawn the instance on the hypervisor.
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-745a710b-79b6-4217-9dc9-f96ddf25ad98 req-e592d424-e95c-474b-b222-5f5675326e07 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updated VIF entry in instance network info cache for port 5248eb08-f20c-4c7e-889e-959facbbc988. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-745a710b-79b6-4217-9dc9-f96ddf25ad98 req-e592d424-e95c-474b-b222-5f5675326e07 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updating instance_info_cache with network_info: [{"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-745a710b-79b6-4217-9dc9-f96ddf25ad98 req-e592d424-e95c-474b-b222-5f5675326e07 service nova] Releasing lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Releasing lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Instance network_info: |[{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-798bce13-a6b5-4be7-86d0-144ba69e3210 req-77657109-4d87-44a2-bd33-797cb073768f service nova] Acquired lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-798bce13-a6b5-4be7-86d0-144ba69e3210 req-77657109-4d87-44a2-bd33-797cb073768f service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Refreshing network info cache for port d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Start _get_guest_xml network_info=[{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:55:50 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:50 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664143132',display_name='tempest-ServerActionsTestOtherA-server-1664143132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664143132',id=4,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-0rjopwim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:55:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=0777bcb5-966e-424a-8732-e53c6352183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=d6a1c323-0e6e-4be7-a45d-d26e3ac2d718,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a1c323-0e') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'pci_devices' on Instance uuid 0777bcb5-966e-424a-8732-e53c6352183e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:55:50 user nova-compute[72803]: INFO nova.compute.manager [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Took 13.70 seconds to build instance.
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:55:50 user nova-compute[72803]:   <uuid>0777bcb5-966e-424a-8732-e53c6352183e</uuid>
Aug 15 06:55:50 user nova-compute[72803]:   <name>instance-00000004</name>
Aug 15 06:55:50 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:55:50 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:55:50 user nova-compute[72803]:   <metadata>
Aug 15 06:55:50 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:55:50 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:55:50 user nova-compute[72803]:       <nova:name>tempest-ServerActionsTestOtherA-server-1664143132</nova:name>
Aug 15 06:55:50 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:55:50</nova:creationTime>
Aug 15 06:55:50 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:55:50 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:55:50 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:55:50 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:55:50 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:55:50 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:55:50 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:55:50 user nova-compute[72803]:       <nova:owner>
Aug 15 06:55:50 user nova-compute[72803]:         <nova:user uuid="f1e4fd69d1a64b8d80b0d1a45d62190f">tempest-ServerActionsTestOtherA-931999183-project-member</nova:user>
Aug 15 06:55:50 user nova-compute[72803]:         <nova:project uuid="ecaf763674bc4aaca9e52eda0cf41f44">tempest-ServerActionsTestOtherA-931999183</nova:project>
Aug 15 06:55:50 user nova-compute[72803]:       </nova:owner>
Aug 15 06:55:50 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:55:50 user nova-compute[72803]:       <nova:ports>
Aug 15 06:55:50 user nova-compute[72803]:         <nova:port uuid="d6a1c323-0e6e-4be7-a45d-d26e3ac2d718">
Aug 15 06:55:50 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 06:55:50 user nova-compute[72803]:         </nova:port>
Aug 15 06:55:50 user nova-compute[72803]:       </nova:ports>
Aug 15 06:55:50 user nova-compute[72803]:     </nova:instance>
Aug 15 06:55:50 user nova-compute[72803]:   </metadata>
Aug 15 06:55:50 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:55:50 user nova-compute[72803]:     <system>
Aug 15 06:55:50 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:55:50 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:55:50 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:55:50 user nova-compute[72803]:       <entry name="serial">0777bcb5-966e-424a-8732-e53c6352183e</entry>
Aug 15 06:55:50 user nova-compute[72803]:       <entry name="uuid">0777bcb5-966e-424a-8732-e53c6352183e</entry>
Aug 15 06:55:50 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:55:50 user nova-compute[72803]:     </system>
Aug 15 06:55:50 user nova-compute[72803]:   </sysinfo>
Aug 15 06:55:50 user nova-compute[72803]:   <os>
Aug 15 06:55:50 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:55:50 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:55:50 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:55:50 user nova-compute[72803]:   </os>
Aug 15 06:55:50 user nova-compute[72803]:   <features>
Aug 15 06:55:50 user nova-compute[72803]:     <acpi/>
Aug 15 06:55:50 user nova-compute[72803]:     <apic/>
Aug 15 06:55:50 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:55:50 user nova-compute[72803]:   </features>
Aug 15 06:55:50 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:55:50 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:55:50 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:55:50 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:55:50 user nova-compute[72803]:   </clock>
Aug 15 06:55:50 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:55:50 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:55:50 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:55:50 user nova-compute[72803]:   </cpu>
Aug 15 06:55:50 user nova-compute[72803]:   <devices>
Aug 15 06:55:50 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:55:50 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:55:50 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk"/>
Aug 15 06:55:50 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:55:50 user nova-compute[72803]:     </disk>
Aug 15 06:55:50 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:55:50 user nova-compute[72803]:       <mac address="fa:16:3e:a2:4e:fb"/>
Aug 15 06:55:50 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:55:50 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:55:50 user nova-compute[72803]:       <target dev="tapd6a1c323-0e"/>
Aug 15 06:55:50 user nova-compute[72803]:     </interface>
Aug 15 06:55:50 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:55:50 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/console.log" append="off"/>
Aug 15 06:55:50 user nova-compute[72803]:     </serial>
Aug 15 06:55:50 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:55:50 user nova-compute[72803]:     <video>
Aug 15 06:55:50 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:55:50 user nova-compute[72803]:     </video>
Aug 15 06:55:50 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:55:50 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:55:50 user nova-compute[72803]:     </rng>
Aug 15 06:55:50 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:55:50 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:55:50 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:55:50 user nova-compute[72803]:     </memballoon>
Aug 15 06:55:50 user nova-compute[72803]:   </devices>
Aug 15 06:55:50 user nova-compute[72803]: </domain>
Aug 15 06:55:50 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664143132',display_name='tempest-ServerActionsTestOtherA-server-1664143132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664143132',id=4,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-0rjopwim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:55:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=0777bcb5-966e-424a-8732-e53c6352183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=d6a1c323-0e6e-4be7-a45d-d26e3ac2d718,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a1c323-0e') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG os_vif [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=d6a1c323-0e6e-4be7-a45d-d26e3ac2d718,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a1c323-0e') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5b962d9-9aca-4dea-8f6e-d1171f3498b2 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.937s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6a1c323-0e, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6a1c323-0e, col_values=(('external_ids', {'iface-id': 'd6a1c323-0e6e-4be7-a45d-d26e3ac2d718', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:4e:fb', 'vm-uuid': '0777bcb5-966e-424a-8732-e53c6352183e'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:50 user nova-compute[72803]: INFO os_vif [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=d6a1c323-0e6e-4be7-a45d-d26e3ac2d718,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a1c323-0e')
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No VIF found with MAC fa:16:3e:a2:4e:fb, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082552.5062137, ff252c72-caf0-4c90-b078-6aab5a0b1fab => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:55:52 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] VM Resumed (Lifecycle Event)
Aug 15 06:55:52 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Instance spawned successfully.
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:52 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082552.507976, ff252c72-caf0-4c90-b078-6aab5a0b1fab => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:55:52 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] VM Started (Lifecycle Event)
Aug 15 06:55:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:55:52 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.network.neutron [req-798bce13-a6b5-4be7-86d0-144ba69e3210 req-77657109-4d87-44a2-bd33-797cb073768f service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updated VIF entry in instance network info cache for port d6a1c323-0e6e-4be7-a45d-d26e3ac2d718. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.network.neutron [req-798bce13-a6b5-4be7-86d0-144ba69e3210 req-77657109-4d87-44a2-bd33-797cb073768f service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:55:52 user nova-compute[72803]: INFO nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Took 14.33 seconds to spawn the instance on the hypervisor.
Aug 15 06:55:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-798bce13-a6b5-4be7-86d0-144ba69e3210 req-77657109-4d87-44a2-bd33-797cb073768f service nova] Releasing lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:55:53 user nova-compute[72803]: INFO nova.compute.manager [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Took 15.42 seconds to build instance.
Aug 15 06:55:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-89a8b903-cdff-473f-b19a-2391ed6d0d22 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.579s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082555.2091377, 0777bcb5-966e-424a-8732-e53c6352183e => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:55:55 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] VM Resumed (Lifecycle Event)
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:55:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Instance spawned successfully.
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:55:55 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082555.2139528, 0777bcb5-966e-424a-8732-e53c6352183e => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:55:55 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] VM Started (Lifecycle Event)
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:55:55 user nova-compute[72803]: INFO nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Took 15.95 seconds to spawn the instance on the hypervisor.
Aug 15 06:55:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:55:55 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:55:55 user nova-compute[72803]: INFO nova.compute.manager [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Took 16.99 seconds to build instance.
Aug 15 06:55:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fac268fd-521f-4e92-8361-d10333d0e7a4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "0777bcb5-966e-424a-8732-e53c6352183e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.261s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:55:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:55:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:55:59 user nova-compute[72803]: INFO nova.compute.claims [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Claim successful on node user
Aug 15 06:55:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:55:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:55:59 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:55:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:55:59 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:55:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.964s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:55:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:56:00 user nova-compute[72803]: INFO nova.compute.claims [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Claim successful on node user
Aug 15 06:56:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:56:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Creating image(s)
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "/opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "/opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.policy [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e992a5e7525e41249ddd5e6fbf1cd24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1922e1157f794f3e8eee8df93e0a6276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-739b5137-b754-4e41-8367-9547a6236c02 req-83e5775f-1cc7-4be8-8392-4a9d501e9aa2 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-739b5137-b754-4e41-8367-9547a6236c02 req-83e5775f-1cc7-4be8-8392-4a9d501e9aa2 service nova] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-739b5137-b754-4e41-8367-9547a6236c02 req-83e5775f-1cc7-4be8-8392-4a9d501e9aa2 service nova] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-739b5137-b754-4e41-8367-9547a6236c02 req-83e5775f-1cc7-4be8-8392-4a9d501e9aa2 service nova] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-739b5137-b754-4e41-8367-9547a6236c02 req-83e5775f-1cc7-4be8-8392-4a9d501e9aa2 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] No waiting events found dispatching network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:00 user nova-compute[72803]: WARNING nova.compute.manager [req-739b5137-b754-4e41-8367-9547a6236c02 req-83e5775f-1cc7-4be8-8392-4a9d501e9aa2 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received unexpected event network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 for instance with vm_state active and task_state None.
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.274s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.250s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.policy [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3fa5c5df3de4b589614d1ca9ab059ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaab00278854c85a4d50c6eed9ad176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk 1073741824" returned: 0 in 0.124s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:01 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.394s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:56:01 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Creating image(s)
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "/opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "/opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "/opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.320s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Cannot resize image /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'migration_context' on Instance uuid 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Ensure instance console log exists: /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.265s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.242s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk 1073741824" returned: 0 in 0.073s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Successfully created port: d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.310s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Cannot resize image /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lazy-loading 'migration_context' on Instance uuid c94b60f1-bfc1-488a-9c12-255a15a29002 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Ensure instance console log exists: /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3b93a679-a970-4bad-a967-b38e4f0854c6 req-5aba4d40-6552-41ef-92a0-ebd6f44b788f service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b93a679-a970-4bad-a967-b38e4f0854c6 req-5aba4d40-6552-41ef-92a0-ebd6f44b788f service nova] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b93a679-a970-4bad-a967-b38e4f0854c6 req-5aba4d40-6552-41ef-92a0-ebd6f44b788f service nova] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b93a679-a970-4bad-a967-b38e4f0854c6 req-5aba4d40-6552-41ef-92a0-ebd6f44b788f service nova] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3b93a679-a970-4bad-a967-b38e4f0854c6 req-5aba4d40-6552-41ef-92a0-ebd6f44b788f service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] No waiting events found dispatching network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:02 user nova-compute[72803]: WARNING nova.compute.manager [req-3b93a679-a970-4bad-a967-b38e4f0854c6 req-5aba4d40-6552-41ef-92a0-ebd6f44b788f service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received unexpected event network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 for instance with vm_state active and task_state None.
Aug 15 06:56:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Successfully created port: cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:56:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:56:03 user nova-compute[72803]: INFO nova.compute.claims [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Claim successful on node user
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Successfully updated port: d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquired lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-d401acbd-ef80-4e97-8765-4915ec23e728 req-5571f9e7-7cf1-443f-acb1-0d85a54ed532 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received event network-changed-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-d401acbd-ef80-4e97-8765-4915ec23e728 req-5571f9e7-7cf1-443f-acb1-0d85a54ed532 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Refreshing instance network info cache due to event network-changed-d9a98be4-bb66-4f3f-a354-5a1767c3c891. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d401acbd-ef80-4e97-8765-4915ec23e728 req-5571f9e7-7cf1-443f-acb1-0d85a54ed532 service nova] Acquiring lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:56:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.policy [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9d48395df784d0e9cf970dbef4d1ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f903ccf5114394b0f54c27459d4ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Successfully updated port: cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquired lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:56:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Creating image(s)
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "/opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "/opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "/opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.085s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "f7956ec0fe7cefd3fb088dbd88c37a985b13876f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "f7956ec0fe7cefd3fb088dbd88c37a985b13876f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updating instance_info_cache with network_info: [{"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Releasing lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Instance network_info: |[{"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d401acbd-ef80-4e97-8765-4915ec23e728 req-5571f9e7-7cf1-443f-acb1-0d85a54ed532 service nova] Acquired lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.network.neutron [req-d401acbd-ef80-4e97-8765-4915ec23e728 req-5571f9e7-7cf1-443f-acb1-0d85a54ed532 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Refreshing network info cache for port d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Start _get_guest_xml network_info=[{"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:56:05 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:05 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-297169688',display_name='tempest-VolumesAdminNegativeTest-server-297169688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-297169688',id=5,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQzz+C54ASqxtg5jc2/cB8BUpPKfINOhMAnTO0I7Sgd21i3Cc837DTVVROvSdzaZw+YT1HdgF6l2As6cgdflUMPHlQztJ2aq9fPaf5wM2MM7shvt8AYS1xBfFt6XixguQ==',key_name='tempest-keypair-858397056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1922e1157f794f3e8eee8df93e0a6276',ramdisk_id='',reservation_id='r-731tvcwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1805149867',owner_user_name='tempest-VolumesAdminNegativeTest-1805149867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e992a5e7525e41249ddd5e6fbf1cd24c',uuid=5c54f0cc-decb-4c4c-a9ef-ab4aecc41060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converting VIF {"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:af:27,bridge_name='br-int',has_traffic_filtering=True,id=d9a98be4-bb66-4f3f-a354-5a1767c3c891,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a98be4-bb') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f.part --force-share --output=json" returned: 0 in 0.211s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.images [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] 3d1ff29e-abd4-430b-b7bb-64b49e14c0a1 was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f.part /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:56:05 user nova-compute[72803]:   <uuid>5c54f0cc-decb-4c4c-a9ef-ab4aecc41060</uuid>
Aug 15 06:56:05 user nova-compute[72803]:   <name>instance-00000005</name>
Aug 15 06:56:05 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:56:05 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:56:05 user nova-compute[72803]:   <metadata>
Aug 15 06:56:05 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:56:05 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:56:05 user nova-compute[72803]:       <nova:name>tempest-VolumesAdminNegativeTest-server-297169688</nova:name>
Aug 15 06:56:05 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:56:05</nova:creationTime>
Aug 15 06:56:05 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:56:05 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:56:05 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:56:05 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:56:05 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:56:05 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:56:05 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:56:05 user nova-compute[72803]:       <nova:owner>
Aug 15 06:56:05 user nova-compute[72803]:         <nova:user uuid="e992a5e7525e41249ddd5e6fbf1cd24c">tempest-VolumesAdminNegativeTest-1805149867-project-member</nova:user>
Aug 15 06:56:05 user nova-compute[72803]:         <nova:project uuid="1922e1157f794f3e8eee8df93e0a6276">tempest-VolumesAdminNegativeTest-1805149867</nova:project>
Aug 15 06:56:05 user nova-compute[72803]:       </nova:owner>
Aug 15 06:56:05 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:56:05 user nova-compute[72803]:       <nova:ports>
Aug 15 06:56:05 user nova-compute[72803]:         <nova:port uuid="d9a98be4-bb66-4f3f-a354-5a1767c3c891">
Aug 15 06:56:05 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 06:56:05 user nova-compute[72803]:         </nova:port>
Aug 15 06:56:05 user nova-compute[72803]:       </nova:ports>
Aug 15 06:56:05 user nova-compute[72803]:     </nova:instance>
Aug 15 06:56:05 user nova-compute[72803]:   </metadata>
Aug 15 06:56:05 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:56:05 user nova-compute[72803]:     <system>
Aug 15 06:56:05 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:56:05 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:56:05 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:56:05 user nova-compute[72803]:       <entry name="serial">5c54f0cc-decb-4c4c-a9ef-ab4aecc41060</entry>
Aug 15 06:56:05 user nova-compute[72803]:       <entry name="uuid">5c54f0cc-decb-4c4c-a9ef-ab4aecc41060</entry>
Aug 15 06:56:05 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:56:05 user nova-compute[72803]:     </system>
Aug 15 06:56:05 user nova-compute[72803]:   </sysinfo>
Aug 15 06:56:05 user nova-compute[72803]:   <os>
Aug 15 06:56:05 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:56:05 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:56:05 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:56:05 user nova-compute[72803]:   </os>
Aug 15 06:56:05 user nova-compute[72803]:   <features>
Aug 15 06:56:05 user nova-compute[72803]:     <acpi/>
Aug 15 06:56:05 user nova-compute[72803]:     <apic/>
Aug 15 06:56:05 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:56:05 user nova-compute[72803]:   </features>
Aug 15 06:56:05 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:56:05 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:56:05 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:56:05 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:56:05 user nova-compute[72803]:   </clock>
Aug 15 06:56:05 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:56:05 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:56:05 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:56:05 user nova-compute[72803]:   </cpu>
Aug 15 06:56:05 user nova-compute[72803]:   <devices>
Aug 15 06:56:05 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:56:05 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:56:05 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk"/>
Aug 15 06:56:05 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:56:05 user nova-compute[72803]:     </disk>
Aug 15 06:56:05 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:56:05 user nova-compute[72803]:       <mac address="fa:16:3e:b7:af:27"/>
Aug 15 06:56:05 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:05 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:56:05 user nova-compute[72803]:       <target dev="tapd9a98be4-bb"/>
Aug 15 06:56:05 user nova-compute[72803]:     </interface>
Aug 15 06:56:05 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:56:05 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/console.log" append="off"/>
Aug 15 06:56:05 user nova-compute[72803]:     </serial>
Aug 15 06:56:05 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:56:05 user nova-compute[72803]:     <video>
Aug 15 06:56:05 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:05 user nova-compute[72803]:     </video>
Aug 15 06:56:05 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:56:05 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:56:05 user nova-compute[72803]:     </rng>
Aug 15 06:56:05 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:56:05 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:56:05 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:56:05 user nova-compute[72803]:     </memballoon>
Aug 15 06:56:05 user nova-compute[72803]:   </devices>
Aug 15 06:56:05 user nova-compute[72803]: </domain>
Aug 15 06:56:05 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-297169688',display_name='tempest-VolumesAdminNegativeTest-server-297169688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-297169688',id=5,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQzz+C54ASqxtg5jc2/cB8BUpPKfINOhMAnTO0I7Sgd21i3Cc837DTVVROvSdzaZw+YT1HdgF6l2As6cgdflUMPHlQztJ2aq9fPaf5wM2MM7shvt8AYS1xBfFt6XixguQ==',key_name='tempest-keypair-858397056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1922e1157f794f3e8eee8df93e0a6276',ramdisk_id='',reservation_id='r-731tvcwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1805149867',owner_user_name='tempest-VolumesAdminNegativeTest-1805149867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e992a5e7525e41249ddd5e6fbf1cd24c',uuid=5c54f0cc-decb-4c4c-a9ef-ab4aecc41060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converting VIF {"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:af:27,bridge_name='br-int',has_traffic_filtering=True,id=d9a98be4-bb66-4f3f-a354-5a1767c3c891,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a98be4-bb') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG os_vif [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:af:27,bridge_name='br-int',has_traffic_filtering=True,id=d9a98be4-bb66-4f3f-a354-5a1767c3c891,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a98be4-bb') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9a98be4-bb, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9a98be4-bb, col_values=(('external_ids', {'iface-id': 'd9a98be4-bb66-4f3f-a354-5a1767c3c891', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:af:27', 'vm-uuid': '5c54f0cc-decb-4c4c-a9ef-ab4aecc41060'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:05 user nova-compute[72803]: INFO os_vif [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:af:27,bridge_name='br-int',has_traffic_filtering=True,id=d9a98be4-bb66-4f3f-a354-5a1767c3c891,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a98be4-bb')
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Successfully created port: 1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f.part /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f.converted" returned: 0 in 0.361s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:56:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] No VIF found with MAC fa:16:3e:b7:af:27, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Updating instance_info_cache with network_info: [{"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Releasing lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Instance network_info: |[{"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Start _get_guest_xml network_info=[{"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:56:06 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:06 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2009508264',display_name='tempest-VolumesAssistedSnapshotsTest-server-2009508264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2009508264',id=6,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVNUcOonDkvpFXkVZq76qUr4fSeKJwk7UVusTTBkW/vHM1iHJtI/Vmsk2RbyaSVOkqQex3ETyNU4resqWo593BddCSfCgujuCBHcnDzUCCPBW6+SsSktHWnNzbPqmp/wA==',key_name='tempest-keypair-2029539496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afaab00278854c85a4d50c6eed9ad176',ramdisk_id='',reservation_id='r-w0uffamp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1594388956',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1594388956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fa5c5df3de4b589614d1ca9ab059ad',uuid=c94b60f1-bfc1-488a-9c12-255a15a29002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Converting VIF {"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:68:65,bridge_name='br-int',has_traffic_filtering=True,id=cc67af0c-51e8-43bf-885f-302f61325c66,network=Network(daa8ce77-7150-4fa2-b620-b9fe46d72bf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc67af0c-51') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lazy-loading 'pci_devices' on Instance uuid c94b60f1-bfc1-488a-9c12-255a15a29002 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-f903c045-e9f8-4fc9-859a-682aad8b3cdc req-01f1199a-f4d8-4a86-934c-aae877b7ac25 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received event network-changed-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-f903c045-e9f8-4fc9-859a-682aad8b3cdc req-01f1199a-f4d8-4a86-934c-aae877b7ac25 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Refreshing instance network info cache due to event network-changed-cc67af0c-51e8-43bf-885f-302f61325c66. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f903c045-e9f8-4fc9-859a-682aad8b3cdc req-01f1199a-f4d8-4a86-934c-aae877b7ac25 service nova] Acquiring lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f903c045-e9f8-4fc9-859a-682aad8b3cdc req-01f1199a-f4d8-4a86-934c-aae877b7ac25 service nova] Acquired lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.network.neutron [req-f903c045-e9f8-4fc9-859a-682aad8b3cdc req-01f1199a-f4d8-4a86-934c-aae877b7ac25 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Refreshing network info cache for port cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:56:06 user nova-compute[72803]:   <uuid>c94b60f1-bfc1-488a-9c12-255a15a29002</uuid>
Aug 15 06:56:06 user nova-compute[72803]:   <name>instance-00000006</name>
Aug 15 06:56:06 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:56:06 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:56:06 user nova-compute[72803]:   <metadata>
Aug 15 06:56:06 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:56:06 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:56:06 user nova-compute[72803]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2009508264</nova:name>
Aug 15 06:56:06 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:56:06</nova:creationTime>
Aug 15 06:56:06 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:56:06 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:56:06 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:56:06 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:56:06 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:56:06 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:56:06 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:56:06 user nova-compute[72803]:       <nova:owner>
Aug 15 06:56:06 user nova-compute[72803]:         <nova:user uuid="c3fa5c5df3de4b589614d1ca9ab059ad">tempest-VolumesAssistedSnapshotsTest-1594388956-project-member</nova:user>
Aug 15 06:56:06 user nova-compute[72803]:         <nova:project uuid="afaab00278854c85a4d50c6eed9ad176">tempest-VolumesAssistedSnapshotsTest-1594388956</nova:project>
Aug 15 06:56:06 user nova-compute[72803]:       </nova:owner>
Aug 15 06:56:06 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:56:06 user nova-compute[72803]:       <nova:ports>
Aug 15 06:56:06 user nova-compute[72803]:         <nova:port uuid="cc67af0c-51e8-43bf-885f-302f61325c66">
Aug 15 06:56:06 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 06:56:06 user nova-compute[72803]:         </nova:port>
Aug 15 06:56:06 user nova-compute[72803]:       </nova:ports>
Aug 15 06:56:06 user nova-compute[72803]:     </nova:instance>
Aug 15 06:56:06 user nova-compute[72803]:   </metadata>
Aug 15 06:56:06 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:56:06 user nova-compute[72803]:     <system>
Aug 15 06:56:06 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:56:06 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:56:06 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:56:06 user nova-compute[72803]:       <entry name="serial">c94b60f1-bfc1-488a-9c12-255a15a29002</entry>
Aug 15 06:56:06 user nova-compute[72803]:       <entry name="uuid">c94b60f1-bfc1-488a-9c12-255a15a29002</entry>
Aug 15 06:56:06 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:56:06 user nova-compute[72803]:     </system>
Aug 15 06:56:06 user nova-compute[72803]:   </sysinfo>
Aug 15 06:56:06 user nova-compute[72803]:   <os>
Aug 15 06:56:06 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:56:06 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:56:06 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:56:06 user nova-compute[72803]:   </os>
Aug 15 06:56:06 user nova-compute[72803]:   <features>
Aug 15 06:56:06 user nova-compute[72803]:     <acpi/>
Aug 15 06:56:06 user nova-compute[72803]:     <apic/>
Aug 15 06:56:06 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:56:06 user nova-compute[72803]:   </features>
Aug 15 06:56:06 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:56:06 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:56:06 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:56:06 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:56:06 user nova-compute[72803]:   </clock>
Aug 15 06:56:06 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:56:06 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:56:06 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:56:06 user nova-compute[72803]:   </cpu>
Aug 15 06:56:06 user nova-compute[72803]:   <devices>
Aug 15 06:56:06 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:56:06 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:56:06 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk"/>
Aug 15 06:56:06 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:56:06 user nova-compute[72803]:     </disk>
Aug 15 06:56:06 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:56:06 user nova-compute[72803]:       <mac address="fa:16:3e:ec:68:65"/>
Aug 15 06:56:06 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:06 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:56:06 user nova-compute[72803]:       <target dev="tapcc67af0c-51"/>
Aug 15 06:56:06 user nova-compute[72803]:     </interface>
Aug 15 06:56:06 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:56:06 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/console.log" append="off"/>
Aug 15 06:56:06 user nova-compute[72803]:     </serial>
Aug 15 06:56:06 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:56:06 user nova-compute[72803]:     <video>
Aug 15 06:56:06 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:06 user nova-compute[72803]:     </video>
Aug 15 06:56:06 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:56:06 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:56:06 user nova-compute[72803]:     </rng>
Aug 15 06:56:06 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:56:06 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:56:06 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:56:06 user nova-compute[72803]:     </memballoon>
Aug 15 06:56:06 user nova-compute[72803]:   </devices>
Aug 15 06:56:06 user nova-compute[72803]: </domain>
Aug 15 06:56:06 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2009508264',display_name='tempest-VolumesAssistedSnapshotsTest-server-2009508264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2009508264',id=6,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVNUcOonDkvpFXkVZq76qUr4fSeKJwk7UVusTTBkW/vHM1iHJtI/Vmsk2RbyaSVOkqQex3ETyNU4resqWo593BddCSfCgujuCBHcnDzUCCPBW6+SsSktHWnNzbPqmp/wA==',key_name='tempest-keypair-2029539496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afaab00278854c85a4d50c6eed9ad176',ramdisk_id='',reservation_id='r-w0uffamp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1594388956',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1594388956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fa5c5df3de4b589614d1ca9ab059ad',uuid=c94b60f1-bfc1-488a-9c12-255a15a29002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Converting VIF {"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:68:65,bridge_name='br-int',has_traffic_filtering=True,id=cc67af0c-51e8-43bf-885f-302f61325c66,network=Network(daa8ce77-7150-4fa2-b620-b9fe46d72bf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc67af0c-51') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG os_vif [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:68:65,bridge_name='br-int',has_traffic_filtering=True,id=cc67af0c-51e8-43bf-885f-302f61325c66,network=Network(daa8ce77-7150-4fa2-b620-b9fe46d72bf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc67af0c-51') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "f7956ec0fe7cefd3fb088dbd88c37a985b13876f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.372s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc67af0c-51, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc67af0c-51, col_values=(('external_ids', {'iface-id': 'cc67af0c-51e8-43bf-885f-302f61325c66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:68:65', 'vm-uuid': 'c94b60f1-bfc1-488a-9c12-255a15a29002'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:06 user nova-compute[72803]: INFO os_vif [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:68:65,bridge_name='br-int',has_traffic_filtering=True,id=cc67af0c-51e8-43bf-885f-302f61325c66,network=Network(daa8ce77-7150-4fa2-b620-b9fe46d72bf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc67af0c-51')
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f --force-share --output=json" returned: 0 in 0.256s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "f7956ec0fe7cefd3fb088dbd88c37a985b13876f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "f7956ec0fe7cefd3fb088dbd88c37a985b13876f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] No VIF found with MAC fa:16:3e:ec:68:65, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.network.neutron [req-d401acbd-ef80-4e97-8765-4915ec23e728 req-5571f9e7-7cf1-443f-acb1-0d85a54ed532 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updated VIF entry in instance network info cache for port d9a98be4-bb66-4f3f-a354-5a1767c3c891. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG nova.network.neutron [req-d401acbd-ef80-4e97-8765-4915ec23e728 req-5571f9e7-7cf1-443f-acb1-0d85a54ed532 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updating instance_info_cache with network_info: [{"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d401acbd-ef80-4e97-8765-4915ec23e728 req-5571f9e7-7cf1-443f-acb1-0d85a54ed532 service nova] Releasing lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f --force-share --output=json" returned: 0 in 0.402s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f,backing_fmt=raw /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f,backing_fmt=raw /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk 1073741824" returned: 0 in 0.099s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "f7956ec0fe7cefd3fb088dbd88c37a985b13876f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.507s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Successfully updated port: 1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquired lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-1214469c-f55f-4a74-92ae-eb6bfae16557 req-9831e06b-faa9-4595-ae7b-d0368c0a1f0c service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received event network-changed-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-1214469c-f55f-4a74-92ae-eb6bfae16557 req-9831e06b-faa9-4595-ae7b-d0368c0a1f0c service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Refreshing instance network info cache due to event network-changed-1aea96c7-e182-4d42-87a3-d88c60d92608. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1214469c-f55f-4a74-92ae-eb6bfae16557 req-9831e06b-faa9-4595-ae7b-d0368c0a1f0c service nova] Acquiring lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f --force-share --output=json" returned: 0 in 0.346s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json" returned: 0 in 0.348s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Cannot resize image /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lazy-loading 'migration_context' on Instance uuid 2daeef6a-2d82-4d18-94ec-11fce8ed7479 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Ensure instance console log exists: /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Updating instance_info_cache with network_info: [{"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Releasing lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Instance network_info: |[{"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1214469c-f55f-4a74-92ae-eb6bfae16557 req-9831e06b-faa9-4595-ae7b-d0368c0a1f0c service nova] Acquired lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.network.neutron [req-1214469c-f55f-4a74-92ae-eb6bfae16557 req-9831e06b-faa9-4595-ae7b-d0368c0a1f0c service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Refreshing network info cache for port 1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Start _get_guest_xml network_info=[{"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:55:55Z,direct_url=<?>,disk_format='qcow2',id=3d1ff29e-abd4-430b-b7bb-64b49e14c0a1,min_disk=0,min_ram=0,name='',owner='75a8d5e522c346988734683b1139e476',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:55:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '3d1ff29e-abd4-430b-b7bb-64b49e14c0a1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:56:08 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:08 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:55:55Z,direct_url=<?>,disk_format='qcow2',id=3d1ff29e-abd4-430b-b7bb-64b49e14c0a1,min_disk=0,min_ram=0,name='',owner='75a8d5e522c346988734683b1139e476',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:55:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-600877834',display_name='tempest-AttachSCSIVolumeTestJSON-server-600877834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-600877834',id=7,image_ref='3d1ff29e-abd4-430b-b7bb-64b49e14c0a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO12QGfS39J1/iISO/PGBUomCVksKDUGTanrGbB+FACcnpUlZExgRpV8+2TUdpIVQSLtR5udTcHkLohekflyL5KzMAozxB7Hy7lMr2GFQeLryTCFgzKSmn8+lC1JA3KwLg==',key_name='tempest-keypair-1400822134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43f903ccf5114394b0f54c27459d4ef3',ramdisk_id='',reservation_id='r-pwevrcck',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3d1ff29e-abd4-430b-b7bb-64b49e14c0a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-81463321',owner_user_name='tempest-AttachSCSIVolumeTestJSON-81463321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d48395df784d0e9cf970dbef4d1ab2',uuid=2daeef6a-2d82-4d18-94ec-11fce8ed7479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Converting VIF {"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:c8,bridge_name='br-int',has_traffic_filtering=True,id=1aea96c7-e182-4d42-87a3-d88c60d92608,network=Network(a6e3f30e-72a6-4507-b033-58ba4343b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aea96c7-e1') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lazy-loading 'pci_devices' on Instance uuid 2daeef6a-2d82-4d18-94ec-11fce8ed7479 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:56:08 user nova-compute[72803]:   <uuid>2daeef6a-2d82-4d18-94ec-11fce8ed7479</uuid>
Aug 15 06:56:08 user nova-compute[72803]:   <name>instance-00000007</name>
Aug 15 06:56:08 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:56:08 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:56:08 user nova-compute[72803]:   <metadata>
Aug 15 06:56:08 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:56:08 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:56:08 user nova-compute[72803]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-600877834</nova:name>
Aug 15 06:56:08 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:56:08</nova:creationTime>
Aug 15 06:56:08 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:56:08 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:56:08 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:56:08 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:56:08 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:56:08 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:56:08 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:56:08 user nova-compute[72803]:       <nova:owner>
Aug 15 06:56:08 user nova-compute[72803]:         <nova:user uuid="b9d48395df784d0e9cf970dbef4d1ab2">tempest-AttachSCSIVolumeTestJSON-81463321-project-member</nova:user>
Aug 15 06:56:08 user nova-compute[72803]:         <nova:project uuid="43f903ccf5114394b0f54c27459d4ef3">tempest-AttachSCSIVolumeTestJSON-81463321</nova:project>
Aug 15 06:56:08 user nova-compute[72803]:       </nova:owner>
Aug 15 06:56:08 user nova-compute[72803]:       <nova:root type="image" uuid="3d1ff29e-abd4-430b-b7bb-64b49e14c0a1"/>
Aug 15 06:56:08 user nova-compute[72803]:       <nova:ports>
Aug 15 06:56:08 user nova-compute[72803]:         <nova:port uuid="1aea96c7-e182-4d42-87a3-d88c60d92608">
Aug 15 06:56:08 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 06:56:08 user nova-compute[72803]:         </nova:port>
Aug 15 06:56:08 user nova-compute[72803]:       </nova:ports>
Aug 15 06:56:08 user nova-compute[72803]:     </nova:instance>
Aug 15 06:56:08 user nova-compute[72803]:   </metadata>
Aug 15 06:56:08 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:56:08 user nova-compute[72803]:     <system>
Aug 15 06:56:08 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:56:08 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:56:08 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:56:08 user nova-compute[72803]:       <entry name="serial">2daeef6a-2d82-4d18-94ec-11fce8ed7479</entry>
Aug 15 06:56:08 user nova-compute[72803]:       <entry name="uuid">2daeef6a-2d82-4d18-94ec-11fce8ed7479</entry>
Aug 15 06:56:08 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:56:08 user nova-compute[72803]:     </system>
Aug 15 06:56:08 user nova-compute[72803]:   </sysinfo>
Aug 15 06:56:08 user nova-compute[72803]:   <os>
Aug 15 06:56:08 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:56:08 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:56:08 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:56:08 user nova-compute[72803]:   </os>
Aug 15 06:56:08 user nova-compute[72803]:   <features>
Aug 15 06:56:08 user nova-compute[72803]:     <acpi/>
Aug 15 06:56:08 user nova-compute[72803]:     <apic/>
Aug 15 06:56:08 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:56:08 user nova-compute[72803]:   </features>
Aug 15 06:56:08 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:56:08 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:56:08 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:56:08 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:56:08 user nova-compute[72803]:   </clock>
Aug 15 06:56:08 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:56:08 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:56:08 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:56:08 user nova-compute[72803]:   </cpu>
Aug 15 06:56:08 user nova-compute[72803]:   <devices>
Aug 15 06:56:08 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:56:08 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:56:08 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk"/>
Aug 15 06:56:08 user nova-compute[72803]:       <target dev="sda" bus="scsi"/>
Aug 15 06:56:08 user nova-compute[72803]:       <address type="drive" controller="0" unit="0"/>
Aug 15 06:56:08 user nova-compute[72803]:     </disk>
Aug 15 06:56:08 user nova-compute[72803]:     <disk type="file" device="cdrom">
Aug 15 06:56:08 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 06:56:08 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk.config"/>
Aug 15 06:56:08 user nova-compute[72803]:       <target dev="sdb" bus="scsi"/>
Aug 15 06:56:08 user nova-compute[72803]:       <address type="drive" controller="0" unit="1"/>
Aug 15 06:56:08 user nova-compute[72803]:     </disk>
Aug 15 06:56:08 user nova-compute[72803]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 06:56:08 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:56:08 user nova-compute[72803]:       <mac address="fa:16:3e:7f:c7:c8"/>
Aug 15 06:56:08 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:08 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:56:08 user nova-compute[72803]:       <target dev="tap1aea96c7-e1"/>
Aug 15 06:56:08 user nova-compute[72803]:     </interface>
Aug 15 06:56:08 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:56:08 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/console.log" append="off"/>
Aug 15 06:56:08 user nova-compute[72803]:     </serial>
Aug 15 06:56:08 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:56:08 user nova-compute[72803]:     <video>
Aug 15 06:56:08 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:08 user nova-compute[72803]:     </video>
Aug 15 06:56:08 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:56:08 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:56:08 user nova-compute[72803]:     </rng>
Aug 15 06:56:08 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:56:08 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:56:08 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:56:08 user nova-compute[72803]:     </memballoon>
Aug 15 06:56:08 user nova-compute[72803]:   </devices>
Aug 15 06:56:08 user nova-compute[72803]: </domain>
Aug 15 06:56:08 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-600877834',display_name='tempest-AttachSCSIVolumeTestJSON-server-600877834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-600877834',id=7,image_ref='3d1ff29e-abd4-430b-b7bb-64b49e14c0a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO12QGfS39J1/iISO/PGBUomCVksKDUGTanrGbB+FACcnpUlZExgRpV8+2TUdpIVQSLtR5udTcHkLohekflyL5KzMAozxB7Hy7lMr2GFQeLryTCFgzKSmn8+lC1JA3KwLg==',key_name='tempest-keypair-1400822134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43f903ccf5114394b0f54c27459d4ef3',ramdisk_id='',reservation_id='r-pwevrcck',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3d1ff29e-abd4-430b-b7bb-64b49e14c0a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-81463321',owner_user_name='tempest-AttachSCSIVolumeTestJSON-81463321-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d48395df784d0e9cf970dbef4d1ab2',uuid=2daeef6a-2d82-4d18-94ec-11fce8ed7479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Converting VIF {"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:c8,bridge_name='br-int',has_traffic_filtering=True,id=1aea96c7-e182-4d42-87a3-d88c60d92608,network=Network(a6e3f30e-72a6-4507-b033-58ba4343b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aea96c7-e1') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG os_vif [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:c8,bridge_name='br-int',has_traffic_filtering=True,id=1aea96c7-e182-4d42-87a3-d88c60d92608,network=Network(a6e3f30e-72a6-4507-b033-58ba4343b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aea96c7-e1') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-f903c045-e9f8-4fc9-859a-682aad8b3cdc req-01f1199a-f4d8-4a86-934c-aae877b7ac25 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Updated VIF entry in instance network info cache for port cc67af0c-51e8-43bf-885f-302f61325c66. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-f903c045-e9f8-4fc9-859a-682aad8b3cdc req-01f1199a-f4d8-4a86-934c-aae877b7ac25 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Updating instance_info_cache with network_info: [{"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aea96c7-e1, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1aea96c7-e1, col_values=(('external_ids', {'iface-id': '1aea96c7-e182-4d42-87a3-d88c60d92608', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:c7:c8', 'vm-uuid': '2daeef6a-2d82-4d18-94ec-11fce8ed7479'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f903c045-e9f8-4fc9-859a-682aad8b3cdc req-01f1199a-f4d8-4a86-934c-aae877b7ac25 service nova] Releasing lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:08 user nova-compute[72803]: INFO os_vif [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c7:c8,bridge_name='br-int',has_traffic_filtering=True,id=1aea96c7-e182-4d42-87a3-d88c60d92608,network=Network(a6e3f30e-72a6-4507-b033-58ba4343b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aea96c7-e1')
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] No BDM found with device name sda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] No VIF found with MAC fa:16:3e:7f:c7:c8, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:56:08 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Using config drive
Aug 15 06:56:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:56:08 user nova-compute[72803]: INFO nova.compute.claims [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Claim successful on node user
Aug 15 06:56:08 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Creating config drive at /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk.config
Aug 15 06:56:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpowooiq2v {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpowooiq2v" returned: 0 in 0.072s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-1214469c-f55f-4a74-92ae-eb6bfae16557 req-9831e06b-faa9-4595-ae7b-d0368c0a1f0c service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Updated VIF entry in instance network info cache for port 1aea96c7-e182-4d42-87a3-d88c60d92608. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-1214469c-f55f-4a74-92ae-eb6bfae16557 req-9831e06b-faa9-4595-ae7b-d0368c0a1f0c service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Updating instance_info_cache with network_info: [{"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1214469c-f55f-4a74-92ae-eb6bfae16557 req-9831e06b-faa9-4595-ae7b-d0368c0a1f0c service nova] Releasing lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.851s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:56:09 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.policy [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f8e6404c768452486b45a430e7946bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9b2d99c28f48ef8d27cd0ff70877ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:56:09 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Creating image(s)
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "/opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "/opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "/opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.214s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.250s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk 1073741824" returned: 0 in 0.064s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Cannot resize image /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lazy-loading 'migration_context' on Instance uuid f015c02e-e530-4ec9-9fac-6efad4535956 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Ensure instance console log exists: /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:11 user nova-compute[72803]: DEBUG nova.network.neutron [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Successfully created port: 416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Successfully updated port: 416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquired lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f82f78d-fb01-4a42-849c-bd7d92126b4a req-3977a8c6-98b9-4f6c-b218-1fc588de8977 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-changed-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f82f78d-fb01-4a42-849c-bd7d92126b4a req-3977a8c6-98b9-4f6c-b218-1fc588de8977 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Refreshing instance network info cache due to event network-changed-416da12a-d56b-4d09-bc66-5b4a195a07bd. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f82f78d-fb01-4a42-849c-bd7d92126b4a req-3977a8c6-98b9-4f6c-b218-1fc588de8977 service nova] Acquiring lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updating instance_info_cache with network_info: [{"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Releasing lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Instance network_info: |[{"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f82f78d-fb01-4a42-849c-bd7d92126b4a req-3977a8c6-98b9-4f6c-b218-1fc588de8977 service nova] Acquired lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f82f78d-fb01-4a42-849c-bd7d92126b4a req-3977a8c6-98b9-4f6c-b218-1fc588de8977 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Refreshing network info cache for port 416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Start _get_guest_xml network_info=[{"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:56:12 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:12 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-98050795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-98050795',id=8,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPKY+eZFkSlg5JqDkuJvKg+ZJP8v4pk8imXoFKXn2eMzTXRBaJk246PztdgOvZODS5yxBQVbWaWO8rygXkwX90itcuhyLQsmgtG7Ne0MJ4N4m9xqLZzVmYrRsewekfXLw==',key_name='tempest-keypair-1472456205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f9b2d99c28f48ef8d27cd0ff70877ce',ramdisk_id='',reservation_id='r-grgwpcsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-954480488',owner_user_name='tempest-TaggedAttachmentsTest-954480488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8e6404c768452486b45a430e7946bb',uuid=f015c02e-e530-4ec9-9fac-6efad4535956,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converting VIF {"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:30:af,bridge_name='br-int',has_traffic_filtering=True,id=416da12a-d56b-4d09-bc66-5b4a195a07bd,network=Network(d354373a-522c-4a30-b3d0-0defdbc0c442),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416da12a-d5') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lazy-loading 'pci_devices' on Instance uuid f015c02e-e530-4ec9-9fac-6efad4535956 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:56:12 user nova-compute[72803]:   <uuid>f015c02e-e530-4ec9-9fac-6efad4535956</uuid>
Aug 15 06:56:12 user nova-compute[72803]:   <name>instance-00000008</name>
Aug 15 06:56:12 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:56:12 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:56:12 user nova-compute[72803]:   <metadata>
Aug 15 06:56:12 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:56:12 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:56:12 user nova-compute[72803]:       <nova:name>tempest-device-tagging-server-98050795</nova:name>
Aug 15 06:56:12 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:56:12</nova:creationTime>
Aug 15 06:56:12 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:56:12 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:56:12 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:56:12 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:56:12 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:56:12 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:56:12 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:56:12 user nova-compute[72803]:       <nova:owner>
Aug 15 06:56:12 user nova-compute[72803]:         <nova:user uuid="9f8e6404c768452486b45a430e7946bb">tempest-TaggedAttachmentsTest-954480488-project-member</nova:user>
Aug 15 06:56:12 user nova-compute[72803]:         <nova:project uuid="1f9b2d99c28f48ef8d27cd0ff70877ce">tempest-TaggedAttachmentsTest-954480488</nova:project>
Aug 15 06:56:12 user nova-compute[72803]:       </nova:owner>
Aug 15 06:56:12 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:56:12 user nova-compute[72803]:       <nova:ports>
Aug 15 06:56:12 user nova-compute[72803]:         <nova:port uuid="416da12a-d56b-4d09-bc66-5b4a195a07bd">
Aug 15 06:56:12 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 06:56:12 user nova-compute[72803]:         </nova:port>
Aug 15 06:56:12 user nova-compute[72803]:       </nova:ports>
Aug 15 06:56:12 user nova-compute[72803]:     </nova:instance>
Aug 15 06:56:12 user nova-compute[72803]:   </metadata>
Aug 15 06:56:12 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:56:12 user nova-compute[72803]:     <system>
Aug 15 06:56:12 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:56:12 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:56:12 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:56:12 user nova-compute[72803]:       <entry name="serial">f015c02e-e530-4ec9-9fac-6efad4535956</entry>
Aug 15 06:56:12 user nova-compute[72803]:       <entry name="uuid">f015c02e-e530-4ec9-9fac-6efad4535956</entry>
Aug 15 06:56:12 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:56:12 user nova-compute[72803]:     </system>
Aug 15 06:56:12 user nova-compute[72803]:   </sysinfo>
Aug 15 06:56:12 user nova-compute[72803]:   <os>
Aug 15 06:56:12 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:56:12 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:56:12 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:56:12 user nova-compute[72803]:   </os>
Aug 15 06:56:12 user nova-compute[72803]:   <features>
Aug 15 06:56:12 user nova-compute[72803]:     <acpi/>
Aug 15 06:56:12 user nova-compute[72803]:     <apic/>
Aug 15 06:56:12 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:56:12 user nova-compute[72803]:   </features>
Aug 15 06:56:12 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:56:12 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:56:12 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:56:12 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:56:12 user nova-compute[72803]:   </clock>
Aug 15 06:56:12 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:56:12 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:56:12 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:56:12 user nova-compute[72803]:   </cpu>
Aug 15 06:56:12 user nova-compute[72803]:   <devices>
Aug 15 06:56:12 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:56:12 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:56:12 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk"/>
Aug 15 06:56:12 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:56:12 user nova-compute[72803]:     </disk>
Aug 15 06:56:12 user nova-compute[72803]:     <disk type="file" device="cdrom">
Aug 15 06:56:12 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 06:56:12 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk.config"/>
Aug 15 06:56:12 user nova-compute[72803]:       <target dev="hda" bus="ide"/>
Aug 15 06:56:12 user nova-compute[72803]:     </disk>
Aug 15 06:56:12 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:56:12 user nova-compute[72803]:       <mac address="fa:16:3e:42:30:af"/>
Aug 15 06:56:12 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:12 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:56:12 user nova-compute[72803]:       <target dev="tap416da12a-d5"/>
Aug 15 06:56:12 user nova-compute[72803]:     </interface>
Aug 15 06:56:12 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:56:12 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/console.log" append="off"/>
Aug 15 06:56:12 user nova-compute[72803]:     </serial>
Aug 15 06:56:12 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:56:12 user nova-compute[72803]:     <video>
Aug 15 06:56:12 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:12 user nova-compute[72803]:     </video>
Aug 15 06:56:12 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:56:12 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:56:12 user nova-compute[72803]:     </rng>
Aug 15 06:56:12 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:56:12 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:56:12 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:56:12 user nova-compute[72803]:     </memballoon>
Aug 15 06:56:12 user nova-compute[72803]:   </devices>
Aug 15 06:56:12 user nova-compute[72803]: </domain>
Aug 15 06:56:12 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-98050795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-98050795',id=8,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPKY+eZFkSlg5JqDkuJvKg+ZJP8v4pk8imXoFKXn2eMzTXRBaJk246PztdgOvZODS5yxBQVbWaWO8rygXkwX90itcuhyLQsmgtG7Ne0MJ4N4m9xqLZzVmYrRsewekfXLw==',key_name='tempest-keypair-1472456205',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f9b2d99c28f48ef8d27cd0ff70877ce',ramdisk_id='',reservation_id='r-grgwpcsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-954480488',owner_user_name='tempest-TaggedAttachmentsTest-954480488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8e6404c768452486b45a430e7946bb',uuid=f015c02e-e530-4ec9-9fac-6efad4535956,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converting VIF {"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:30:af,bridge_name='br-int',has_traffic_filtering=True,id=416da12a-d56b-4d09-bc66-5b4a195a07bd,network=Network(d354373a-522c-4a30-b3d0-0defdbc0c442),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416da12a-d5') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG os_vif [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:30:af,bridge_name='br-int',has_traffic_filtering=True,id=416da12a-d56b-4d09-bc66-5b4a195a07bd,network=Network(d354373a-522c-4a30-b3d0-0defdbc0c442),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416da12a-d5') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap416da12a-d5, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap416da12a-d5, col_values=(('external_ids', {'iface-id': '416da12a-d56b-4d09-bc66-5b4a195a07bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:30:af', 'vm-uuid': 'f015c02e-e530-4ec9-9fac-6efad4535956'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:12 user nova-compute[72803]: INFO os_vif [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:30:af,bridge_name='br-int',has_traffic_filtering=True,id=416da12a-d56b-4d09-bc66-5b4a195a07bd,network=Network(d354373a-522c-4a30-b3d0-0defdbc0c442),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416da12a-d5')
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] No BDM found with device name hda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] No VIF found with MAC fa:16:3e:42:30:af, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:56:12 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Using config drive
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:56:13 user nova-compute[72803]: INFO nova.compute.claims [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Claim successful on node user
Aug 15 06:56:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Creating config drive at /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk.config
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb3q8lcbp {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb3q8lcbp" returned: 0 in 0.066s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f82f78d-fb01-4a42-849c-bd7d92126b4a req-3977a8c6-98b9-4f6c-b218-1fc588de8977 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updated VIF entry in instance network info cache for port 416da12a-d56b-4d09-bc66-5b4a195a07bd. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f82f78d-fb01-4a42-849c-bd7d92126b4a req-3977a8c6-98b9-4f6c-b218-1fc588de8977 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updating instance_info_cache with network_info: [{"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f82f78d-fb01-4a42-849c-bd7d92126b4a req-3977a8c6-98b9-4f6c-b218-1fc588de8977 service nova] Releasing lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.network.neutron [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:56:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.policy [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab553427c4f0495aa6524aec1a7adc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56258d381827464ea24efccfe501b213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:56:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Creating image(s)
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "/opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "/opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ceaa6bd-d38d-4e5f-9175-3e5350053145 req-9363c989-68c6-4674-9d8a-c0e77c9b994a service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received event network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ceaa6bd-d38d-4e5f-9175-3e5350053145 req-9363c989-68c6-4674-9d8a-c0e77c9b994a service nova] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ceaa6bd-d38d-4e5f-9175-3e5350053145 req-9363c989-68c6-4674-9d8a-c0e77c9b994a service nova] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ceaa6bd-d38d-4e5f-9175-3e5350053145 req-9363c989-68c6-4674-9d8a-c0e77c9b994a service nova] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ceaa6bd-d38d-4e5f-9175-3e5350053145 req-9363c989-68c6-4674-9d8a-c0e77c9b994a service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] No waiting events found dispatching network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:13 user nova-compute[72803]: WARNING nova.compute.manager [req-2ceaa6bd-d38d-4e5f-9175-3e5350053145 req-9363c989-68c6-4674-9d8a-c0e77c9b994a service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received unexpected event network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 for instance with vm_state active and task_state None.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082574.0974607, c94b60f1-bfc1-488a-9c12-255a15a29002 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] VM Resumed (Lifecycle Event)
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Instance spawned successfully.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Instance spawned successfully.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Instance spawned successfully.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082574.112064, 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] VM Resumed (Lifecycle Event)
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Took 12.88 seconds to spawn the instance on the hypervisor.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082574.1195548, 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] VM Started (Lifecycle Event)
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.311s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk 1073741824" returned: 0 in 0.051s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Took 9.75 seconds to spawn the instance on the hypervisor.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Took 14.43 seconds to build instance.
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Took 14.07 seconds to spawn the instance on the hypervisor.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2255b8e1-c4c8-4ec9-bf37-89ca8e3a9dd8 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.705s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082574.1225495, c94b60f1-bfc1-488a-9c12-255a15a29002 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] VM Started (Lifecycle Event)
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Took 10.82 seconds to build instance.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b29508ca-6d38-4a6c-a2a5-1ff49e637462 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.007s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082574.1241095, 2daeef6a-2d82-4d18-94ec-11fce8ed7479 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] VM Resumed (Lifecycle Event)
Aug 15 06:56:14 user nova-compute[72803]: INFO nova.compute.manager [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Took 15.77 seconds to build instance.
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.306s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.network.neutron [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Successfully created port: 360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1c3dd1f2-4585-4c03-837a-dffdfbcd8d32 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.187s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Cannot resize image /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.objects.instance [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lazy-loading 'migration_context' on Instance uuid 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082574.1264427, 2daeef6a-2d82-4d18-94ec-11fce8ed7479 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:15 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] VM Started (Lifecycle Event)
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Ensure instance console log exists: /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-33a831d5-d7de-4790-8594-67ba4ec402fe req-ef9f1cbb-4bb2-4a85-93ec-f1a71a94e6c1 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33a831d5-d7de-4790-8594-67ba4ec402fe req-ef9f1cbb-4bb2-4a85-93ec-f1a71a94e6c1 service nova] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33a831d5-d7de-4790-8594-67ba4ec402fe req-ef9f1cbb-4bb2-4a85-93ec-f1a71a94e6c1 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33a831d5-d7de-4790-8594-67ba4ec402fe req-ef9f1cbb-4bb2-4a85-93ec-f1a71a94e6c1 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-33a831d5-d7de-4790-8594-67ba4ec402fe req-ef9f1cbb-4bb2-4a85-93ec-f1a71a94e6c1 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] No waiting events found dispatching network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:15 user nova-compute[72803]: WARNING nova.compute.manager [req-33a831d5-d7de-4790-8594-67ba4ec402fe req-ef9f1cbb-4bb2-4a85-93ec-f1a71a94e6c1 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received unexpected event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 for instance with vm_state active and task_state None.
Aug 15 06:56:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-6fa2690e-9b38-43a4-bc82-d8510fe628c2 req-800d0950-586b-4e6b-a537-582d034a2f8a service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6fa2690e-9b38-43a4-bc82-d8510fe628c2 req-800d0950-586b-4e6b-a537-582d034a2f8a service nova] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6fa2690e-9b38-43a4-bc82-d8510fe628c2 req-800d0950-586b-4e6b-a537-582d034a2f8a service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6fa2690e-9b38-43a4-bc82-d8510fe628c2 req-800d0950-586b-4e6b-a537-582d034a2f8a service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-6fa2690e-9b38-43a4-bc82-d8510fe628c2 req-800d0950-586b-4e6b-a537-582d034a2f8a service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] No waiting events found dispatching network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:15 user nova-compute[72803]: WARNING nova.compute.manager [req-6fa2690e-9b38-43a4-bc82-d8510fe628c2 req-800d0950-586b-4e6b-a537-582d034a2f8a service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received unexpected event network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd for instance with vm_state building and task_state spawning.
Aug 15 06:56:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:16 user nova-compute[72803]: DEBUG nova.compute.manager [req-5468b2fe-1ba4-4a86-99da-0f5fd296554a req-b8d1a8cf-b179-4094-a0d6-d445bd1092c9 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received event network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5468b2fe-1ba4-4a86-99da-0f5fd296554a req-b8d1a8cf-b179-4094-a0d6-d445bd1092c9 service nova] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5468b2fe-1ba4-4a86-99da-0f5fd296554a req-b8d1a8cf-b179-4094-a0d6-d445bd1092c9 service nova] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5468b2fe-1ba4-4a86-99da-0f5fd296554a req-b8d1a8cf-b179-4094-a0d6-d445bd1092c9 service nova] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:16 user nova-compute[72803]: DEBUG nova.compute.manager [req-5468b2fe-1ba4-4a86-99da-0f5fd296554a req-b8d1a8cf-b179-4094-a0d6-d445bd1092c9 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] No waiting events found dispatching network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:16 user nova-compute[72803]: WARNING nova.compute.manager [req-5468b2fe-1ba4-4a86-99da-0f5fd296554a req-b8d1a8cf-b179-4094-a0d6-d445bd1092c9 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received unexpected event network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 for instance with vm_state active and task_state None.
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.neutron [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Successfully updated port: 360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquired lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.neutron [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.neutron [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] No waiting events found dispatching network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:17 user nova-compute[72803]: WARNING nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received unexpected event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 for instance with vm_state active and task_state None.
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received event network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] No waiting events found dispatching network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:17 user nova-compute[72803]: WARNING nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received unexpected event network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 for instance with vm_state active and task_state None.
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received event network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] No waiting events found dispatching network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:17 user nova-compute[72803]: WARNING nova.compute.manager [req-342be5cd-1b11-42b2-a657-06c200765a89 req-9326f65b-40a0-4288-aaa2-7c2984b6af71 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received unexpected event network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 for instance with vm_state active and task_state None.
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.neutron [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Updating instance_info_cache with network_info: [{"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Releasing lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Instance network_info: |[{"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Start _get_guest_xml network_info=[{"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:56:17 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:17 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1956766012',display_name='tempest-TestVolumeSwap-server-1956766012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1956766012',id=9,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBUrgjUoG7/hhqUsST8WlOcK2IGvo6uGtK62aw/jCK5iJR121NCfTyCxodTvDuu4vCa9sUKIGN2JRTi1ZXwSENCbGqgLpr5ZYlnEu2+jSRfx3rBwdajPgYgN49ABqYcxg==',key_name='tempest-keypair-1865542447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56258d381827464ea24efccfe501b213',ramdisk_id='',reservation_id='r-xu0b1nsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1505291325',owner_user_name='tempest-TestVolumeSwap-1505291325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab553427c4f0495aa6524aec1a7adc40',uuid=0cb66e88-04aa-47cb-b403-16e16704a9f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Converting VIF {"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:01:db,bridge_name='br-int',has_traffic_filtering=True,id=360678a7-0b9e-453e-9a29-15e9b88ac0c4,network=Network(38fea282-8fd4-4109-818b-982805385f7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360678a7-0b') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.objects.instance [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:56:17 user nova-compute[72803]:   <uuid>0cb66e88-04aa-47cb-b403-16e16704a9f9</uuid>
Aug 15 06:56:17 user nova-compute[72803]:   <name>instance-00000009</name>
Aug 15 06:56:17 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:56:17 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:56:17 user nova-compute[72803]:   <metadata>
Aug 15 06:56:17 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:56:17 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:56:17 user nova-compute[72803]:       <nova:name>tempest-TestVolumeSwap-server-1956766012</nova:name>
Aug 15 06:56:17 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:56:17</nova:creationTime>
Aug 15 06:56:17 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:56:17 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:56:17 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:56:17 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:56:17 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:56:17 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:56:17 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:56:17 user nova-compute[72803]:       <nova:owner>
Aug 15 06:56:17 user nova-compute[72803]:         <nova:user uuid="ab553427c4f0495aa6524aec1a7adc40">tempest-TestVolumeSwap-1505291325-project-member</nova:user>
Aug 15 06:56:17 user nova-compute[72803]:         <nova:project uuid="56258d381827464ea24efccfe501b213">tempest-TestVolumeSwap-1505291325</nova:project>
Aug 15 06:56:17 user nova-compute[72803]:       </nova:owner>
Aug 15 06:56:17 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:56:17 user nova-compute[72803]:       <nova:ports>
Aug 15 06:56:17 user nova-compute[72803]:         <nova:port uuid="360678a7-0b9e-453e-9a29-15e9b88ac0c4">
Aug 15 06:56:17 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 06:56:17 user nova-compute[72803]:         </nova:port>
Aug 15 06:56:17 user nova-compute[72803]:       </nova:ports>
Aug 15 06:56:17 user nova-compute[72803]:     </nova:instance>
Aug 15 06:56:17 user nova-compute[72803]:   </metadata>
Aug 15 06:56:17 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:56:17 user nova-compute[72803]:     <system>
Aug 15 06:56:17 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:56:17 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:56:17 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:56:17 user nova-compute[72803]:       <entry name="serial">0cb66e88-04aa-47cb-b403-16e16704a9f9</entry>
Aug 15 06:56:17 user nova-compute[72803]:       <entry name="uuid">0cb66e88-04aa-47cb-b403-16e16704a9f9</entry>
Aug 15 06:56:17 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:56:17 user nova-compute[72803]:     </system>
Aug 15 06:56:17 user nova-compute[72803]:   </sysinfo>
Aug 15 06:56:17 user nova-compute[72803]:   <os>
Aug 15 06:56:17 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:56:17 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:56:17 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:56:17 user nova-compute[72803]:   </os>
Aug 15 06:56:17 user nova-compute[72803]:   <features>
Aug 15 06:56:17 user nova-compute[72803]:     <acpi/>
Aug 15 06:56:17 user nova-compute[72803]:     <apic/>
Aug 15 06:56:17 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:56:17 user nova-compute[72803]:   </features>
Aug 15 06:56:17 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:56:17 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:56:17 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:56:17 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:56:17 user nova-compute[72803]:   </clock>
Aug 15 06:56:17 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:56:17 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:56:17 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:56:17 user nova-compute[72803]:   </cpu>
Aug 15 06:56:17 user nova-compute[72803]:   <devices>
Aug 15 06:56:17 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:56:17 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:56:17 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk"/>
Aug 15 06:56:17 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:56:17 user nova-compute[72803]:     </disk>
Aug 15 06:56:17 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:56:17 user nova-compute[72803]:       <mac address="fa:16:3e:87:01:db"/>
Aug 15 06:56:17 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:17 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:56:17 user nova-compute[72803]:       <target dev="tap360678a7-0b"/>
Aug 15 06:56:17 user nova-compute[72803]:     </interface>
Aug 15 06:56:17 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:56:17 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/console.log" append="off"/>
Aug 15 06:56:17 user nova-compute[72803]:     </serial>
Aug 15 06:56:17 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:56:17 user nova-compute[72803]:     <video>
Aug 15 06:56:17 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:56:17 user nova-compute[72803]:     </video>
Aug 15 06:56:17 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:56:17 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:56:17 user nova-compute[72803]:     </rng>
Aug 15 06:56:17 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:56:17 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:56:17 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:56:17 user nova-compute[72803]:     </memballoon>
Aug 15 06:56:17 user nova-compute[72803]:   </devices>
Aug 15 06:56:17 user nova-compute[72803]: </domain>
Aug 15 06:56:17 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1956766012',display_name='tempest-TestVolumeSwap-server-1956766012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1956766012',id=9,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBUrgjUoG7/hhqUsST8WlOcK2IGvo6uGtK62aw/jCK5iJR121NCfTyCxodTvDuu4vCa9sUKIGN2JRTi1ZXwSENCbGqgLpr5ZYlnEu2+jSRfx3rBwdajPgYgN49ABqYcxg==',key_name='tempest-keypair-1865542447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56258d381827464ea24efccfe501b213',ramdisk_id='',reservation_id='r-xu0b1nsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1505291325',owner_user_name='tempest-TestVolumeSwap-1505291325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab553427c4f0495aa6524aec1a7adc40',uuid=0cb66e88-04aa-47cb-b403-16e16704a9f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Converting VIF {"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:01:db,bridge_name='br-int',has_traffic_filtering=True,id=360678a7-0b9e-453e-9a29-15e9b88ac0c4,network=Network(38fea282-8fd4-4109-818b-982805385f7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360678a7-0b') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG os_vif [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:01:db,bridge_name='br-int',has_traffic_filtering=True,id=360678a7-0b9e-453e-9a29-15e9b88ac0c4,network=Network(38fea282-8fd4-4109-818b-982805385f7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360678a7-0b') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] No waiting events found dispatching network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:17 user nova-compute[72803]: WARNING nova.compute.manager [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received unexpected event network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd for instance with vm_state building and task_state spawning.
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received event network-changed-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Refreshing instance network info cache due to event network-changed-360678a7-0b9e-453e-9a29-15e9b88ac0c4. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] Acquiring lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] Acquired lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.network.neutron [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Refreshing network info cache for port 360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap360678a7-0b, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap360678a7-0b, col_values=(('external_ids', {'iface-id': '360678a7-0b9e-453e-9a29-15e9b88ac0c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:01:db', 'vm-uuid': '0cb66e88-04aa-47cb-b403-16e16704a9f9'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:17 user nova-compute[72803]: INFO os_vif [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:01:db,bridge_name='br-int',has_traffic_filtering=True,id=360678a7-0b9e-453e-9a29-15e9b88ac0c4,network=Network(38fea282-8fd4-4109-818b-982805385f7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360678a7-0b')
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082577.9295912, f015c02e-e530-4ec9-9fac-6efad4535956 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:17 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] VM Resumed (Lifecycle Event)
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:56:17 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Instance spawned successfully.
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] No VIF found with MAC fa:16:3e:87:01:db, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:56:18 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082577.9302113, f015c02e-e530-4ec9-9fac-6efad4535956 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:18 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] VM Started (Lifecycle Event)
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:18 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:56:18 user nova-compute[72803]: INFO nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Took 8.47 seconds to spawn the instance on the hypervisor.
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:18 user nova-compute[72803]: INFO nova.compute.manager [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Took 9.91 seconds to build instance.
Aug 15 06:56:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-83c4e2d8-8168-4f9c-8aa4-d8ca9d0ef671 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.069s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.network.neutron [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Updated VIF entry in instance network info cache for port 360678a7-0b9e-453e-9a29-15e9b88ac0c4. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG nova.network.neutron [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Updating instance_info_cache with network_info: [{"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-530c62c1-f412-4e04-bc0e-2b2371393da7 req-4c9d0293-9f2e-48b1-a88c-cd478d3ad69e service nova] Releasing lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-16628398-059d-430e-ba2a-2fc79aad6899 req-67a0e97f-c9bd-4004-9369-e7a57a15533f service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received event network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16628398-059d-430e-ba2a-2fc79aad6899 req-67a0e97f-c9bd-4004-9369-e7a57a15533f service nova] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16628398-059d-430e-ba2a-2fc79aad6899 req-67a0e97f-c9bd-4004-9369-e7a57a15533f service nova] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16628398-059d-430e-ba2a-2fc79aad6899 req-67a0e97f-c9bd-4004-9369-e7a57a15533f service nova] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-16628398-059d-430e-ba2a-2fc79aad6899 req-67a0e97f-c9bd-4004-9369-e7a57a15533f service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] No waiting events found dispatching network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:21 user nova-compute[72803]: WARNING nova.compute.manager [req-16628398-059d-430e-ba2a-2fc79aad6899 req-67a0e97f-c9bd-4004-9369-e7a57a15533f service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received unexpected event network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 for instance with vm_state active and task_state None.
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082582.331618, 0cb66e88-04aa-47cb-b403-16e16704a9f9 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:22 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] VM Resumed (Lifecycle Event)
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:56:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Instance spawned successfully.
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:56:22 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082582.338343, 0cb66e88-04aa-47cb-b403-16e16704a9f9 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:56:22 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] VM Started (Lifecycle Event)
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:22 user nova-compute[72803]: INFO nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Took 8.69 seconds to spawn the instance on the hypervisor.
Aug 15 06:56:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:56:22 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:56:22 user nova-compute[72803]: INFO nova.compute.manager [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Took 9.88 seconds to build instance.
Aug 15 06:56:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-03a06f71-51ad-4ec7-ad0c-8eb1d721800b tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.984s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received event network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] No waiting events found dispatching network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:23 user nova-compute[72803]: WARNING nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received unexpected event network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 for instance with vm_state active and task_state None.
Aug 15 06:56:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received event network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] No waiting events found dispatching network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:23 user nova-compute[72803]: WARNING nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received unexpected event network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 for instance with vm_state active and task_state None.
Aug 15 06:56:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received event network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] No waiting events found dispatching network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:23 user nova-compute[72803]: WARNING nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received unexpected event network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 for instance with vm_state active and task_state None.
Aug 15 06:56:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received event network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] No waiting events found dispatching network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:23 user nova-compute[72803]: WARNING nova.compute.manager [req-9ee5bbc2-d8c7-42f7-848c-3db8ee759ba8 req-5139e59a-71bb-4db3-a4fd-c44f6e5028c5 service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received unexpected event network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 for instance with vm_state active and task_state None.
Aug 15 06:56:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:56:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:56:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:24 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:56:24 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updating instance_info_cache with network_info: [{"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-758ea595-cb8f-4af9-afb8-3361ac634b9f req-e6f58bd2-ff8c-4a09-a0dd-5bd6b4115cff service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received event network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-758ea595-cb8f-4af9-afb8-3361ac634b9f req-e6f58bd2-ff8c-4a09-a0dd-5bd6b4115cff service nova] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-758ea595-cb8f-4af9-afb8-3361ac634b9f req-e6f58bd2-ff8c-4a09-a0dd-5bd6b4115cff service nova] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-758ea595-cb8f-4af9-afb8-3361ac634b9f req-e6f58bd2-ff8c-4a09-a0dd-5bd6b4115cff service nova] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-758ea595-cb8f-4af9-afb8-3361ac634b9f req-e6f58bd2-ff8c-4a09-a0dd-5bd6b4115cff service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] No waiting events found dispatching network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:25 user nova-compute[72803]: WARNING nova.compute.manager [req-758ea595-cb8f-4af9-afb8-3361ac634b9f req-e6f58bd2-ff8c-4a09-a0dd-5bd6b4115cff service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received unexpected event network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 for instance with vm_state active and task_state None.
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:30 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:30 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:56:30 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7506MB free_disk=25.886375427246094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:56:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 454ea345-aaa5-423b-add3-20a933978eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ff252c72-caf0-4c90-b078-6aab5a0b1fab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c94b60f1-bfc1-488a-9c12-255a15a29002 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 2daeef6a-2d82-4d18-94ec-11fce8ed7479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f015c02e-e530-4ec9-9fac-6efad4535956 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:56:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.786s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:56:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-1e41eeb3-ba83-4782-aaf8-02234ee326f5 req-6c332b90-ba43-4171-8ad8-b765e5924df7 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received event network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1e41eeb3-ba83-4782-aaf8-02234ee326f5 req-6c332b90-ba43-4171-8ad8-b765e5924df7 service nova] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1e41eeb3-ba83-4782-aaf8-02234ee326f5 req-6c332b90-ba43-4171-8ad8-b765e5924df7 service nova] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1e41eeb3-ba83-4782-aaf8-02234ee326f5 req-6c332b90-ba43-4171-8ad8-b765e5924df7 service nova] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-1e41eeb3-ba83-4782-aaf8-02234ee326f5 req-6c332b90-ba43-4171-8ad8-b765e5924df7 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] No waiting events found dispatching network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:32 user nova-compute[72803]: WARNING nova.compute.manager [req-1e41eeb3-ba83-4782-aaf8-02234ee326f5 req-6c332b90-ba43-4171-8ad8-b765e5924df7 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received unexpected event network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 for instance with vm_state active and task_state None.
Aug 15 06:56:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-8d08f9c2-4083-4396-a44a-cd5dcdb38376 req-8853f06f-aed3-4438-93b0-4c7836572c6e service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received event network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8d08f9c2-4083-4396-a44a-cd5dcdb38376 req-8853f06f-aed3-4438-93b0-4c7836572c6e service nova] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8d08f9c2-4083-4396-a44a-cd5dcdb38376 req-8853f06f-aed3-4438-93b0-4c7836572c6e service nova] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8d08f9c2-4083-4396-a44a-cd5dcdb38376 req-8853f06f-aed3-4438-93b0-4c7836572c6e service nova] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-8d08f9c2-4083-4396-a44a-cd5dcdb38376 req-8853f06f-aed3-4438-93b0-4c7836572c6e service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] No waiting events found dispatching network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:56:34 user nova-compute[72803]: WARNING nova.compute.manager [req-8d08f9c2-4083-4396-a44a-cd5dcdb38376 req-8853f06f-aed3-4438-93b0-4c7836572c6e service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received unexpected event network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 for instance with vm_state active and task_state None.
Aug 15 06:56:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:56:49 user nova-compute[72803]: INFO nova.compute.claims [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Claim successful on node user
Aug 15 06:56:49 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:56:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:56:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:56:49 user nova-compute[72803]: INFO nova.virt.block_device [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Booting with volume 42d64473-73bb-4f84-8c63-4c7442dc9c74 at /dev/vda
Aug 15 06:56:49 user nova-compute[72803]: DEBUG nova.policy [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27bed5c19c0e4872a755ba7350ee1d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c3886587c54c7281d4da2afb3ddadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:56:49 user nova-compute[72803]: DEBUG os_brick.utils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:56:49 user nova-compute[72803]: INFO oslo.privsep.daemon [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5gcjhvg6/privsep.sock']
Aug 15 06:56:49 user sudo[84132]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5gcjhvg6/privsep.sock
Aug 15 06:56:49 user sudo[84132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 06:56:50 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully created port: 66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:51 user sudo[84132]: pam_unix(sudo:session): session closed for user root
Aug 15 06:56:51 user nova-compute[72803]: INFO oslo.privsep.daemon [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Spawned new privsep daemon via rootwrap
Aug 15 06:56:51 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 06:56:51 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 06:56:51 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 06:56:51 user nova-compute[72803]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84151
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d29c5-ae01-4b8a-b2a4-d3255fe91c42]: (2,) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully created port: cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[83860e99-a0f1-41af-a892-0d3f00a874cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:51 user nova-compute[72803]: WARNING os_brick.initiator.connectors.nvmeof [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[11878dbf-aabd-4345-a575-35a28f51a592]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c5c1d-e6dd-46a6-ab6d-3484dd820c74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f052a76-db19-47cb-a1ae-f270be34b80b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:56:51 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:56:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f91349-a6c4-4c60-86f2-182ac5add67a]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG os_brick.utils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== get_connector_properties: return (1938ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:56:51 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating existing volume attachment record: b212ace3-b84c-4e11-bd32-0d2ad2372891 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:56:52 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully created port: 8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:53 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully created port: 9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:54 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully created port: 73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully updated port: 66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-29de5b8b-f3f5-4c44-92c3-c8bf882bd337 req-1e2b53b2-8c6f-4e43-ac58-3d9469e9ee97 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-changed-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-29de5b8b-f3f5-4c44-92c3-c8bf882bd337 req-1e2b53b2-8c6f-4e43-ac58-3d9469e9ee97 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing instance network info cache due to event network-changed-66f37461-2446-4ec8-acaa-a6728062d656. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-29de5b8b-f3f5-4c44-92c3-c8bf882bd337 req-1e2b53b2-8c6f-4e43-ac58-3d9469e9ee97 service nova] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-29de5b8b-f3f5-4c44-92c3-c8bf882bd337 req-1e2b53b2-8c6f-4e43-ac58-3d9469e9ee97 service nova] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.network.neutron [req-29de5b8b-f3f5-4c44-92c3-c8bf882bd337 req-1e2b53b2-8c6f-4e43-ac58-3d9469e9ee97 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing network info cache for port 66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.network.neutron [req-29de5b8b-f3f5-4c44-92c3-c8bf882bd337 req-1e2b53b2-8c6f-4e43-ac58-3d9469e9ee97 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:56:55 user nova-compute[72803]: INFO nova.compute.claims [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Claim successful on node user
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.network.neutron [req-29de5b8b-f3f5-4c44-92c3-c8bf882bd337 req-1e2b53b2-8c6f-4e43-ac58-3d9469e9ee97 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-29de5b8b-f3f5-4c44-92c3-c8bf882bd337 req-1e2b53b2-8c6f-4e43-ac58-3d9469e9ee97 service nova] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully updated port: 9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:56:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:56:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:56:56 user nova-compute[72803]: INFO nova.virt.block_device [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Booting with volume df43cefc-ab8e-4217-9f9a-60280056a282 at /dev/vda
Aug 15 06:56:56 user nova-compute[72803]: DEBUG os_brick.utils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG nova.policy [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '250cd0a9c2534451a8ddd9cd82a91eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3be2ca2f3443a2afa55b98f722620d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2719beac-c2c3-42fe-9403-3de795d9a667]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7c54c1-78f2-4eda-9400-40beb8794e82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bc1242-ee35-447e-8f14-e61710dc1b6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b115cf-1dde-4bd5-91de-bd18e432e2a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:56:56 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:56:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[270fb02c-0e33-4a62-aa2d-f4ac8d226021]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG os_brick.utils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating existing volume attachment record: e1da616e-6444-4426-96bd-1e9bd2c1ea41 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully updated port: 544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:56 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully created port: 7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-changed-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing instance network info cache due to event network-changed-9890d264-59a1-45c6-ae4e-38d4c247d002. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing network info cache for port 9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully updated port: cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully created port: bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-changed-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing instance network info cache due to event network-changed-544213fa-d329-4fdc-932f-e0e66c659e9a. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing network info cache for port 544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:56:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4018ac8b-d558-4111-a1f1-f4b95b1c630c req-271e434a-13b1-42ea-97aa-182e5dcdab90 service nova] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully updated port: 8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully created port: 31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully updated port: 9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully created port: 5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-changed-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing instance network info cache due to event network-changed-cbc79d7d-12af-4c59-bb93-571748f8620a. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing network info cache for port cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-changed-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing instance network info cache due to event network-changed-8e77e94b-cd4d-40b4-924f-10f67266d802. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing network info cache for port 8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Successfully updated port: 73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:56:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-changed-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing instance network info cache due to event network-changed-9a9ad424-1879-420f-ad8e-960e1ae78d3b. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing network info cache for port 9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully created port: 5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3a5fddc8-fb90-4e88-93e9-daa253013711 req-0c5b0c6f-7459-491c-873f-4fe6045475fb service nova] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:57:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:01 user nova-compute[72803]: INFO nova.virt.block_device [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Booting with volume 824038eb-18f8-46c0-9c21-6f9719d8fd41 at /dev/vdb
Aug 15 06:57:01 user nova-compute[72803]: DEBUG os_brick.utils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8233b3c5-7fee-4e92-a64a-51c0a6d6ce1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f31448-5df7-4685-9028-eba96225dcd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0e6fdd-77e8-41f6-8ee1-9bcd1acdd7c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e9da41-5fce-4b63-8cbb-eab7abef2b48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:01 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c4aaae-b43d-42d5-a09c-0eca88110fa5]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG os_brick.utils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating existing volume attachment record: e7ca3c32-276b-40a0-8635-f7657f20a08b {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-be514bec-8348-4399-ae29-1913e34096f3 req-daf71e71-1074-45b7-87c4-aca6ea2ea4da service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-changed-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-be514bec-8348-4399-ae29-1913e34096f3 req-daf71e71-1074-45b7-87c4-aca6ea2ea4da service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing instance network info cache due to event network-changed-73595875-33de-4f73-a8bd-a939ef40aa34. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-be514bec-8348-4399-ae29-1913e34096f3 req-daf71e71-1074-45b7-87c4-aca6ea2ea4da service nova] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully updated port: 7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-2815260f-5ed9-49d2-9a42-0631e3a925b1 req-c214dac2-d691-4e0b-80bd-ed36f78b05f7 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-changed-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-2815260f-5ed9-49d2-9a42-0631e3a925b1 req-c214dac2-d691-4e0b-80bd-ed36f78b05f7 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing instance network info cache due to event network-changed-7ef268dd-8261-4e19-a09e-f1a5ccb4a036. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2815260f-5ed9-49d2-9a42-0631e3a925b1 req-c214dac2-d691-4e0b-80bd-ed36f78b05f7 service nova] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2815260f-5ed9-49d2-9a42-0631e3a925b1 req-c214dac2-d691-4e0b-80bd-ed36f78b05f7 service nova] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-2815260f-5ed9-49d2-9a42-0631e3a925b1 req-c214dac2-d691-4e0b-80bd-ed36f78b05f7 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing network info cache for port 7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-2815260f-5ed9-49d2-9a42-0631e3a925b1 req-c214dac2-d691-4e0b-80bd-ed36f78b05f7 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-2815260f-5ed9-49d2-9a42-0631e3a925b1 req-c214dac2-d691-4e0b-80bd-ed36f78b05f7 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2815260f-5ed9-49d2-9a42-0631e3a925b1 req-c214dac2-d691-4e0b-80bd-ed36f78b05f7 service nova] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully updated port: fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:57:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:57:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:57:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-e2a0665f-ee59-4cc3-afdc-2062c1de0eb1 req-c3099e00-80c9-4971-b61d-3472ebc90f3d service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-changed-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-e2a0665f-ee59-4cc3-afdc-2062c1de0eb1 req-c3099e00-80c9-4971-b61d-3472ebc90f3d service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing instance network info cache due to event network-changed-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e2a0665f-ee59-4cc3-afdc-2062c1de0eb1 req-c3099e00-80c9-4971-b61d-3472ebc90f3d service nova] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e2a0665f-ee59-4cc3-afdc-2062c1de0eb1 req-c3099e00-80c9-4971-b61d-3472ebc90f3d service nova] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:03 user nova-compute[72803]: DEBUG nova.network.neutron [req-e2a0665f-ee59-4cc3-afdc-2062c1de0eb1 req-c3099e00-80c9-4971-b61d-3472ebc90f3d service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing network info cache for port fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:03 user nova-compute[72803]: DEBUG nova.network.neutron [req-e2a0665f-ee59-4cc3-afdc-2062c1de0eb1 req-c3099e00-80c9-4971-b61d-3472ebc90f3d service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-e2a0665f-ee59-4cc3-afdc-2062c1de0eb1 req-c3099e00-80c9-4971-b61d-3472ebc90f3d service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e2a0665f-ee59-4cc3-afdc-2062c1de0eb1 req-c3099e00-80c9-4971-b61d-3472ebc90f3d service nova] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [{"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance network_info: |[{"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-be514bec-8348-4399-ae29-1913e34096f3 req-daf71e71-1074-45b7-87c4-aca6ea2ea4da service nova] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-be514bec-8348-4399-ae29-1913e34096f3 req-daf71e71-1074-45b7-87c4-aca6ea2ea4da service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing network info cache for port 73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully updated port: 8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-be514bec-8348-4399-ae29-1913e34096f3 req-daf71e71-1074-45b7-87c4-aca6ea2ea4da service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updated VIF entry in instance network info cache for port 73595875-33de-4f73-a8bd-a939ef40aa34. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-be514bec-8348-4399-ae29-1913e34096f3 req-daf71e71-1074-45b7-87c4-aca6ea2ea4da service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [{"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-be514bec-8348-4399-ae29-1913e34096f3 req-daf71e71-1074-45b7-87c4-aca6ea2ea4da service nova] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully updated port: bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:05 user nova-compute[72803]: INFO nova.virt.block_device [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Booting with volume 48a11f13-ce2f-4abb-8864-e8b2a19d5a65 at /dev/vdb
Aug 15 06:57:05 user nova-compute[72803]: DEBUG os_brick.utils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc5d33c-edef-4f03-91a3-cd05284ffad6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96169c7-ade2-41be-98f9-f0842d45dec6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad7376-8881-498b-8eeb-e342b8cebdcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cf13f7-b132-40e5-bb75-0b6bf39b4a85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:05 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[925dfaa8-ec97-4c3c-928b-06938df2295c]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG os_brick.utils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating existing volume attachment record: 2494ea35-f560-4ae3-964a-1bd58cb9c446 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-changed-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing instance network info cache due to event network-changed-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing network info cache for port 8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:05 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully updated port: 31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-changed-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing instance network info cache due to event network-changed-bd972609-e9bc-43d8-9c53-629c9a1dba59. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing network info cache for port bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a805ed6-d924-467a-b349-ca45f8771159 req-7d33ae6e-c87f-4f4c-a5c7-5ed556ca7e99 service nova] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully updated port: 5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-changed-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing instance network info cache due to event network-changed-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:07 user nova-compute[72803]: DEBUG nova.network.neutron [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing network info cache for port 31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-changed-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing instance network info cache due to event network-changed-5449c4c2-88f5-492a-9640-c785d926de8b. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing network info cache for port 5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Successfully updated port: 5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-947ad67a-28d8-4af6-948e-bae15fd14e09 req-ed0d4240-3600-40ad-869f-6c5b0bc568b5 service nova] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:57:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-7f431cb8-c6fa-49b6-bb75-56e799ac4b78 req-e6b16c3c-b0d6-4a61-916d-eab736ec4bac service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-changed-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-7f431cb8-c6fa-49b6-bb75-56e799ac4b78 req-e6b16c3c-b0d6-4a61-916d-eab736ec4bac service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing instance network info cache due to event network-changed-5c30b612-476a-4410-8a38-81d20e09e021. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7f431cb8-c6fa-49b6-bb75-56e799ac4b78 req-e6b16c3c-b0d6-4a61-916d-eab736ec4bac service nova] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG nova.network.neutron [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [{"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:10 user nova-compute[72803]: INFO nova.virt.block_device [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Booting with volume b78be5ee-b0c3-444f-a4e0-27a63db565cc at /dev/vdc
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance network_info: |[{"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7f431cb8-c6fa-49b6-bb75-56e799ac4b78 req-e6b16c3c-b0d6-4a61-916d-eab736ec4bac service nova] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-7f431cb8-c6fa-49b6-bb75-56e799ac4b78 req-e6b16c3c-b0d6-4a61-916d-eab736ec4bac service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing network info cache for port 5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG os_brick.utils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896d061-8a85-4a6a-a2ac-3a54d55ca9d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e329af-592f-45eb-ad01-ed1f54e664ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bceff7-8a79-413b-81e9-f5f677163aa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[35393e83-679b-4c29-9004-4642f57c164d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:10 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:57:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef4a2ab-0e73-452e-8115-f7ca6ce99e37]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG os_brick.utils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:10 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating existing volume attachment record: 1484edea-8b5d-4029-895b-81572bd202db {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:57:11 user nova-compute[72803]: DEBUG nova.network.neutron [req-7f431cb8-c6fa-49b6-bb75-56e799ac4b78 req-e6b16c3c-b0d6-4a61-916d-eab736ec4bac service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updated VIF entry in instance network info cache for port 5c30b612-476a-4410-8a38-81d20e09e021. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:11 user nova-compute[72803]: DEBUG nova.network.neutron [req-7f431cb8-c6fa-49b6-bb75-56e799ac4b78 req-e6b16c3c-b0d6-4a61-916d-eab736ec4bac service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [{"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7f431cb8-c6fa-49b6-bb75-56e799ac4b78 req-e6b16c3c-b0d6-4a61-916d-eab736ec4bac service nova] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:13 user nova-compute[72803]: INFO nova.compute.manager [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] instance snapshotting
Aug 15 06:57:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Beginning live snapshot process
Aug 15 06:57:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json -f qcow2 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json -f qcow2 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0k1kkt1z/d425c00939ae482c9cc0f556729d6ae3.delta 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0k1kkt1z/d425c00939ae482c9cc0f556729d6ae3.delta 1073741824" returned: 0 in 0.047s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 06:57:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72803) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 06:57:14 user nova-compute[72803]: INFO nova.virt.libvirt.host [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] UEFI support detected
Aug 15 06:57:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:15 user nova-compute[72803]: INFO nova.virt.block_device [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Booting with volume 64e5a6aa-1301-42fd-b80f-a32376121775 at /dev/vdc
Aug 15 06:57:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:57:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 06:57:15 user nova-compute[72803]: DEBUG os_brick.utils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e51e3b-ecc1-4de6-93c6-629076a65a00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872d050-f6cd-4a81-80e5-036566d6aca4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0k1kkt1z/d425c00939ae482c9cc0f556729d6ae3.delta /opt/stack/data/nova/instances/snapshots/tmp0k1kkt1z/d425c00939ae482c9cc0f556729d6ae3 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e659437-312c-44f1-94a2-8de6b1100e18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9924f5de-82bd-4332-8251-6839ea68ea35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:15 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba450618-47f1-4566-aabb-1b6d8dad6fe8]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG os_brick.utils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating existing volume attachment record: 831d3a88-8e07-468e-9d25-53aae10e6d39 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:57:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0k1kkt1z/d425c00939ae482c9cc0f556729d6ae3.delta /opt/stack/data/nova/instances/snapshots/tmp0k1kkt1z/d425c00939ae482c9cc0f556729d6ae3" returned: 0 in 0.401s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:16 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Snapshot extracted, beginning image upload
Aug 15 06:57:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Snapshot image upload complete
Aug 15 06:57:18 user nova-compute[72803]: INFO nova.compute.manager [None req-74854425-7991-4578-b7ee-fe1056194f6f tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Took 5.33 seconds to snapshot the instance on the hypervisor.
Aug 15 06:57:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:57:20 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Creating image(s)
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Ensure instance console log exists: /opt/stack/data/nova/instances/cec4b0a2-dcfd-418e-af89-d0289651dd0d/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Start _get_guest_xml network_info=[{"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'b212ace3-b84c-4e11-bd32-0d2ad2372891', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AREdQGJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d', 'attached_at': '', 'detached_at': '', 'volume_id': '42d64473-73bb-4f84-8c63-4c7442dc9c74', 'serial': '42d64473-73bb-4f84-8c63-4c7442dc9c74'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'e7ca3c32-276b-40a0-8635-f7657f20a08b', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGmAwapt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d', 'attached_at': '', 'detached_at': '', 'volume_id': '824038eb-18f8-46c0-9c21-6f9719d8fd41', 'serial': '824038eb-18f8-46c0-9c21-6f9719d8fd41'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '1484edea-8b5d-4029-895b-81572bd202db', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIlwNYqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d', 'attached_at': '', 'detached_at': '', 'volume_id': 'b78be5ee-b0c3-444f-a4e0-27a63db565cc', 'serial': 'b78be5ee-b0c3-444f-a4e0-27a63db565cc'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:57:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connector [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Factory for ISCSI on None {{(pid=72803) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.011s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AREdQGJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:20 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:20 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:20 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca97900-b2a0-4936-b05a-f8437cbc09cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:57:20 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1684ba-6ced-49c5-8252-527b97f1fa9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74] added
Aug 15 06:57:20 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccddf6c-493a-48b1-bfe3-a1d703d7cde1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[886af486-9645-4684-b2ac-69bf16418b33]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AREdQGJD {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AREdQGJD" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[353aa90e-842b-452e-b059-067bcb17f832]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AREdQGJD'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c19b63a-5594-4b51-9301-b6620cf0cd6d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[da719f58-81ae-4ca0-9cdc-bee716b4ccc7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:57:20 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:57:20 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:20 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 06:57:20 user nova-compute[72803]: 
Aug 15 06:57:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[909bc859-face-4df0-add8-01f0658c65b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74, portal: 172.16.0.220,3260]
Aug 15 06:57:21 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74, portal: 172.16.0.220,3260] successful.
Aug 15 06:57:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf167b6-0c5f-4ada-ad46-9e7ce74ce1cb]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8014724f-aad9-4614-ab38-a3f0e61429d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[73985567-1638-45b0-a4cb-b561cd80cf7f]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AREdQGJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23762636534353436', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762636534353436', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGmAwapt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:22 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:22 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:22 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee578c3a-0fc0-4c11-805b-1d4993345ff6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:57:22 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[85146682-922a-4fd7-91fe-c8ab8c4fbea8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41] added
Aug 15 06:57:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae3a1f6-2c06-4514-81f4-581950742635]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0915837-807f-4dbd-95cc-06867cae3ac8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGmAwapt {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGmAwapt" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea18f1b7-60c6-42b3-a85c-665eea352845]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lGmAwapt'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ba8d5c-818c-4c67-87ef-8e31396c4eef]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1ac209-cf6d-44a2-aac3-469c58f3ee70]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[946981ea-7f59-4e50-b39c-6d6ce450a66f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41, portal: 172.16.0.220,3260]
Aug 15 06:57:22 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41, portal: 172.16.0.220,3260] successful.
Aug 15 06:57:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2514a3c-0def-4a9f-8623-9aa1e0ed5a0b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbf244a-ac7a-4d58-b927-c37880cbe287]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:22 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:22 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4b3266-22a6-471f-a1e6-3ea54f2e7fd7]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGmAwapt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23435383336373538', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435383336373538', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIlwNYqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:23 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:23 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:23 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d15ece1-7718-47d0-a1b9-380641dd0801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:57:23 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa1ff7-1678-4312-9f6f-29705fa2301e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc] added
Aug 15 06:57:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5061f6-328d-4cd6-90d2-3ac470869509]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026579c-5387-4856-85af-2d1e4483cf40]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIlwNYqU {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIlwNYqU" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5541f16-cdcf-49be-92df-088275cb99fd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pIlwNYqU'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b772ff-747e-425b-b3f0-35d2bdd7e446]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcae1eb-9ccb-426b-a7b0-984e8623bee7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:23 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:23 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ebe2c6-a5c1-42c7-834d-4cc6ccd02f94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc, portal: 172.16.0.220,3260]
Aug 15 06:57:23 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc, portal: 172.16.0.220,3260] successful.
Aug 15 06:57:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34687ba-aeff-49cf-9307-0b139aaaf4fd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a7082-f861-45d1-91c7-44a50f8a76a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:23 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:23 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:23 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:23 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50f3040-2b2c-4e12-a337-89e4a5defed1]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIlwNYqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23532343962666436', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532343962666436', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:48,bridge_name='br-int',has_traffic_filtering=True,id=66f37461-2446-4ec8-acaa-a6728062d656,network=Network(55f3fbac-a266-4911-9685-0cdc83d1d58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f37461-24') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:29,bridge_name='br-int',has_traffic_filtering=True,id=9890d264-59a1-45c6-ae4e-38d4c247d002,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9890d264-59') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:72:a2,bridge_name='br-int',has_traffic_filtering=True,id=544213fa-d329-4fdc-932f-e0e66c659e9a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap544213fa-d3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=cbc79d7d-12af-4c59-bb93-571748f8620a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc79d7d-12') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:87:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e77e94b-cd4d-40b4-924f-10f67266d802,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e77e94b-cd') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7f:7b,bridge_name='br-int',has_traffic_filtering=True,id=9a9ad424-1879-420f-ad8e-960e1ae78d3b,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9ad424-18') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:11,bridge_name='br-int',has_traffic_filtering=True,id=73595875-33de-4f73-a8bd-a939ef40aa34,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73595875-33') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.objects.instance [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lazy-loading 'pci_devices' on Instance uuid cec4b0a2-dcfd-418e-af89-d0289651dd0d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:57:24 user nova-compute[72803]:   <uuid>cec4b0a2-dcfd-418e-af89-d0289651dd0d</uuid>
Aug 15 06:57:24 user nova-compute[72803]:   <name>instance-0000000a</name>
Aug 15 06:57:24 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:57:24 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:57:24 user nova-compute[72803]:   <metadata>
Aug 15 06:57:24 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:57:24 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:57:24 user nova-compute[72803]:       <nova:name>tempest-device-tagging-server-1664563546</nova:name>
Aug 15 06:57:24 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:57:20</nova:creationTime>
Aug 15 06:57:24 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:57:24 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:57:24 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:57:24 user nova-compute[72803]:       <nova:owner>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:user uuid="27bed5c19c0e4872a755ba7350ee1d40">tempest-TaggedBootDevicesTest-935268704-project-member</nova:user>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:project uuid="a4c3886587c54c7281d4da2afb3ddadc">tempest-TaggedBootDevicesTest-935268704</nova:project>
Aug 15 06:57:24 user nova-compute[72803]:       </nova:owner>
Aug 15 06:57:24 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:57:24 user nova-compute[72803]:       <nova:ports>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:port uuid="66f37461-2446-4ec8-acaa-a6728062d656">
Aug 15 06:57:24 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 06:57:24 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:port uuid="9890d264-59a1-45c6-ae4e-38d4c247d002">
Aug 15 06:57:24 user nova-compute[72803]:           <nova:ip type="fixed" address="10.1.1.212" ipVersion="4"/>
Aug 15 06:57:24 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:port uuid="544213fa-d329-4fdc-932f-e0e66c659e9a">
Aug 15 06:57:24 user nova-compute[72803]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Aug 15 06:57:24 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:port uuid="cbc79d7d-12af-4c59-bb93-571748f8620a">
Aug 15 06:57:24 user nova-compute[72803]:           <nova:ip type="fixed" address="10.1.1.207" ipVersion="4"/>
Aug 15 06:57:24 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:port uuid="8e77e94b-cd4d-40b4-924f-10f67266d802">
Aug 15 06:57:24 user nova-compute[72803]:           <nova:ip type="fixed" address="10.1.1.86" ipVersion="4"/>
Aug 15 06:57:24 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:port uuid="9a9ad424-1879-420f-ad8e-960e1ae78d3b">
Aug 15 06:57:24 user nova-compute[72803]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 06:57:24 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:24 user nova-compute[72803]:         <nova:port uuid="73595875-33de-4f73-a8bd-a939ef40aa34">
Aug 15 06:57:24 user nova-compute[72803]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 06:57:24 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:24 user nova-compute[72803]:       </nova:ports>
Aug 15 06:57:24 user nova-compute[72803]:     </nova:instance>
Aug 15 06:57:24 user nova-compute[72803]:   </metadata>
Aug 15 06:57:24 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:57:24 user nova-compute[72803]:     <system>
Aug 15 06:57:24 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:57:24 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:57:24 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:57:24 user nova-compute[72803]:       <entry name="serial">cec4b0a2-dcfd-418e-af89-d0289651dd0d</entry>
Aug 15 06:57:24 user nova-compute[72803]:       <entry name="uuid">cec4b0a2-dcfd-418e-af89-d0289651dd0d</entry>
Aug 15 06:57:24 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:57:24 user nova-compute[72803]:     </system>
Aug 15 06:57:24 user nova-compute[72803]:   </sysinfo>
Aug 15 06:57:24 user nova-compute[72803]:   <os>
Aug 15 06:57:24 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:57:24 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:57:24 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:57:24 user nova-compute[72803]:   </os>
Aug 15 06:57:24 user nova-compute[72803]:   <features>
Aug 15 06:57:24 user nova-compute[72803]:     <acpi/>
Aug 15 06:57:24 user nova-compute[72803]:     <apic/>
Aug 15 06:57:24 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:57:24 user nova-compute[72803]:   </features>
Aug 15 06:57:24 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:57:24 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:57:24 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:57:24 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:57:24 user nova-compute[72803]:   </clock>
Aug 15 06:57:24 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:57:24 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:57:24 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:57:24 user nova-compute[72803]:   </cpu>
Aug 15 06:57:24 user nova-compute[72803]:   <devices>
Aug 15 06:57:24 user nova-compute[72803]:     <disk type="file" device="cdrom">
Aug 15 06:57:24 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 06:57:24 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/cec4b0a2-dcfd-418e-af89-d0289651dd0d/disk.config"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="hda" bus="ide"/>
Aug 15 06:57:24 user nova-compute[72803]:     </disk>
Aug 15 06:57:24 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 06:57:24 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:57:24 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <serial>42d64473-73bb-4f84-8c63-4c7442dc9c74</serial>
Aug 15 06:57:24 user nova-compute[72803]:     </disk>
Aug 15 06:57:24 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 06:57:24 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:57:24 user nova-compute[72803]:       <source dev="/dev/sdc"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <serial>824038eb-18f8-46c0-9c21-6f9719d8fd41</serial>
Aug 15 06:57:24 user nova-compute[72803]:     </disk>
Aug 15 06:57:24 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 06:57:24 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:57:24 user nova-compute[72803]:       <source dev="/dev/sdd"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="vdc" bus="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <serial>b78be5ee-b0c3-444f-a4e0-27a63db565cc</serial>
Aug 15 06:57:24 user nova-compute[72803]:     </disk>
Aug 15 06:57:24 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:24 user nova-compute[72803]:       <mac address="fa:16:3e:2d:df:48"/>
Aug 15 06:57:24 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="tap66f37461-24"/>
Aug 15 06:57:24 user nova-compute[72803]:     </interface>
Aug 15 06:57:24 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:24 user nova-compute[72803]:       <mac address="fa:16:3e:dc:4d:29"/>
Aug 15 06:57:24 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="tap9890d264-59"/>
Aug 15 06:57:24 user nova-compute[72803]:     </interface>
Aug 15 06:57:24 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:24 user nova-compute[72803]:       <mac address="fa:16:3e:52:72:a2"/>
Aug 15 06:57:24 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="tap544213fa-d3"/>
Aug 15 06:57:24 user nova-compute[72803]:     </interface>
Aug 15 06:57:24 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:24 user nova-compute[72803]:       <mac address="fa:16:3e:5f:21:a7"/>
Aug 15 06:57:24 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="tapcbc79d7d-12"/>
Aug 15 06:57:24 user nova-compute[72803]:     </interface>
Aug 15 06:57:24 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:24 user nova-compute[72803]:       <mac address="fa:16:3e:d5:87:c7"/>
Aug 15 06:57:24 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="tap8e77e94b-cd"/>
Aug 15 06:57:24 user nova-compute[72803]:     </interface>
Aug 15 06:57:24 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:24 user nova-compute[72803]:       <mac address="fa:16:3e:c2:7f:7b"/>
Aug 15 06:57:24 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="tap9a9ad424-18"/>
Aug 15 06:57:24 user nova-compute[72803]:     </interface>
Aug 15 06:57:24 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:24 user nova-compute[72803]:       <mac address="fa:16:3e:5a:0a:11"/>
Aug 15 06:57:24 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:24 user nova-compute[72803]:       <target dev="tap73595875-33"/>
Aug 15 06:57:24 user nova-compute[72803]:     </interface>
Aug 15 06:57:24 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:57:24 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/cec4b0a2-dcfd-418e-af89-d0289651dd0d/console.log" append="off"/>
Aug 15 06:57:24 user nova-compute[72803]:     </serial>
Aug 15 06:57:24 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:57:24 user nova-compute[72803]:     <video>
Aug 15 06:57:24 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:24 user nova-compute[72803]:     </video>
Aug 15 06:57:24 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:57:24 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:57:24 user nova-compute[72803]:     </rng>
Aug 15 06:57:24 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:57:24 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:57:24 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:57:24 user nova-compute[72803]:     </memballoon>
Aug 15 06:57:24 user nova-compute[72803]:   </devices>
Aug 15 06:57:24 user nova-compute[72803]: </domain>
Aug 15 06:57:24 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:48,bridge_name='br-int',has_traffic_filtering=True,id=66f37461-2446-4ec8-acaa-a6728062d656,network=Network(55f3fbac-a266-4911-9685-0cdc83d1d58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f37461-24') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:48,bridge_name='br-int',has_traffic_filtering=True,id=66f37461-2446-4ec8-acaa-a6728062d656,network=Network(55f3fbac-a266-4911-9685-0cdc83d1d58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f37461-24') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66f37461-24, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66f37461-24, col_values=(('external_ids', {'iface-id': '66f37461-2446-4ec8-acaa-a6728062d656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:df:48', 'vm-uuid': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:24 user nova-compute[72803]: INFO os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:df:48,bridge_name='br-int',has_traffic_filtering=True,id=66f37461-2446-4ec8-acaa-a6728062d656,network=Network(55f3fbac-a266-4911-9685-0cdc83d1d58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f37461-24')
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:29,bridge_name='br-int',has_traffic_filtering=True,id=9890d264-59a1-45c6-ae4e-38d4c247d002,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9890d264-59') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:29,bridge_name='br-int',has_traffic_filtering=True,id=9890d264-59a1-45c6-ae4e-38d4c247d002,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9890d264-59') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9890d264-59, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9890d264-59, col_values=(('external_ids', {'iface-id': '9890d264-59a1-45c6-ae4e-38d4c247d002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:4d:29', 'vm-uuid': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: INFO os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:29,bridge_name='br-int',has_traffic_filtering=True,id=9890d264-59a1-45c6-ae4e-38d4c247d002,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9890d264-59')
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:72:a2,bridge_name='br-int',has_traffic_filtering=True,id=544213fa-d329-4fdc-932f-e0e66c659e9a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap544213fa-d3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:72:a2,bridge_name='br-int',has_traffic_filtering=True,id=544213fa-d329-4fdc-932f-e0e66c659e9a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap544213fa-d3') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap544213fa-d3, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap544213fa-d3, col_values=(('external_ids', {'iface-id': '544213fa-d329-4fdc-932f-e0e66c659e9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:72:a2', 'vm-uuid': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: INFO os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:72:a2,bridge_name='br-int',has_traffic_filtering=True,id=544213fa-d329-4fdc-932f-e0e66c659e9a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap544213fa-d3')
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=cbc79d7d-12af-4c59-bb93-571748f8620a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc79d7d-12') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=cbc79d7d-12af-4c59-bb93-571748f8620a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc79d7d-12') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbc79d7d-12, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbc79d7d-12, col_values=(('external_ids', {'iface-id': 'cbc79d7d-12af-4c59-bb93-571748f8620a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:21:a7', 'vm-uuid': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: INFO os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=cbc79d7d-12af-4c59-bb93-571748f8620a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc79d7d-12')
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:87:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e77e94b-cd4d-40b4-924f-10f67266d802,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e77e94b-cd') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:87:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e77e94b-cd4d-40b4-924f-10f67266d802,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e77e94b-cd') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e77e94b-cd, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e77e94b-cd, col_values=(('external_ids', {'iface-id': '8e77e94b-cd4d-40b4-924f-10f67266d802', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:87:c7', 'vm-uuid': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: INFO os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:87:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e77e94b-cd4d-40b4-924f-10f67266d802,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e77e94b-cd')
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7f:7b,bridge_name='br-int',has_traffic_filtering=True,id=9a9ad424-1879-420f-ad8e-960e1ae78d3b,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9ad424-18') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7f:7b,bridge_name='br-int',has_traffic_filtering=True,id=9a9ad424-1879-420f-ad8e-960e1ae78d3b,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9ad424-18') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a9ad424-18, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a9ad424-18, col_values=(('external_ids', {'iface-id': '9a9ad424-1879-420f-ad8e-960e1ae78d3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:7f:7b', 'vm-uuid': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: INFO os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7f:7b,bridge_name='br-int',has_traffic_filtering=True,id=9a9ad424-1879-420f-ad8e-960e1ae78d3b,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9ad424-18')
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:11,bridge_name='br-int',has_traffic_filtering=True,id=73595875-33de-4f73-a8bd-a939ef40aa34,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73595875-33') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:11,bridge_name='br-int',has_traffic_filtering=True,id=73595875-33de-4f73-a8bd-a939ef40aa34,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73595875-33') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73595875-33, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73595875-33, col_values=(('external_ids', {'iface-id': '73595875-33de-4f73-a8bd-a939ef40aa34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:0a:11', 'vm-uuid': 'cec4b0a2-dcfd-418e-af89-d0289651dd0d'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:25 user nova-compute[72803]: INFO os_vif [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:11,bridge_name='br-int',has_traffic_filtering=True,id=73595875-33de-4f73-a8bd-a939ef40aa34,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73595875-33')
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] No BDM found with device name hda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] No VIF found with MAC fa:16:3e:2d:df:48, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] No VIF found with MAC fa:16:3e:d5:87:c7, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:57:25 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Using config drive
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:25 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Creating config drive at /opt/stack/data/nova/instances/cec4b0a2-dcfd-418e-af89-d0289651dd0d/disk.config
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cec4b0a2-dcfd-418e-af89-d0289651dd0d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpii593h2n {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cec4b0a2-dcfd-418e-af89-d0289651dd0d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpii593h2n" returned: 0 in 0.052s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:57:25 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Creating image(s)
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Ensure instance console log exists: /opt/stack/data/nova/instances/7d3ab35f-ec73-444d-9cc3-e62213f19918/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Start _get_guest_xml network_info=[{"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'e1da616e-6444-4426-96bd-1e9bd2c1ea41', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQGCigpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d3ab35f-ec73-444d-9cc3-e62213f19918', 'attached_at': '', 'detached_at': '', 'volume_id': 'df43cefc-ab8e-4217-9f9a-60280056a282', 'serial': 'df43cefc-ab8e-4217-9f9a-60280056a282'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '2494ea35-f560-4ae3-964a-1bd58cb9c446', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNgeDYmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d3ab35f-ec73-444d-9cc3-e62213f19918', 'attached_at': '', 'detached_at': '', 'volume_id': '48a11f13-ce2f-4abb-8864-e8b2a19d5a65', 'serial': '48a11f13-ce2f-4abb-8864-e8b2a19d5a65'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '831d3a88-8e07-468e-9d25-53aae10e6d39', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUivPTnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d3ab35f-ec73-444d-9cc3-e62213f19918', 'attached_at': '', 'detached_at': '', 'volume_id': '64e5a6aa-1301-42fd-b80f-a32376121775', 'serial': '64e5a6aa-1301-42fd-b80f-a32376121775'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:57:25 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:25 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQGCigpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:25 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:25 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:25 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2960f09-8001-4b9a-b884-b051673c7e52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:57:25 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beaff9d-6c2e-4ca5-8f7d-e3d57efedb95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282] added
Aug 15 06:57:25 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c22ce5-2403-47a6-a295-4d5d78b392cb]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c035b71d-7551-4f2c-b58d-0dee1c98a257]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQGCigpJ {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQGCigpJ" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edddb49-695b-4876-9052-4df0005ce698]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UQGCigpJ'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5671c0e-ec11-41b6-a9f8-a7f3d3bddd69]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba5b82-9e80-4f46-be92-24aaf62ba3d5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:25 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:25 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:25 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:25 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:25 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:25 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d9ac1c-cc78-4b51-a5c4-3d72fafc4d86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282, portal: 172.16.0.220,3260]
Aug 15 06:57:25 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282, portal: 172.16.0.220,3260] successful.
Aug 15 06:57:25 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[408b6f05-f423-4334-b8b9-238ce22e951a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7fe946-6987-4365-a22e-eaff789a7e87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:26 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:26 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:26 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:26 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:26 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:26 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eece38-28b6-43b2-97ff-f66e665c15ae]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQGCigpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26237386437643630', 'path': '/dev/sde'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237386437643630', 'path': '/dev/sde'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNgeDYmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:27 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:27 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:27 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96b973e-17df-46cf-bfa8-d78b91bc0a33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:57:27 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac167ff9-5a6b-4f7e-b53a-4c5688f7b8ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65] added
Aug 15 06:57:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e0d534-2e86-4de7-b53c-16c778b48955]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6953429-6db5-4291-98fc-e1021cce6ca4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GNgeDYmu {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GNgeDYmu" returned: 0 in 0.031s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a7c2d3-9511-4a1c-8d57-1ba5baf0d42f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GNgeDYmu'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cfd744-0437-43a8-ab23-9c25e752e101]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f19c812-f4d9-49b1-b7d7-e22dc20e26c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cbacbf-2faa-4650-9d08-271d5b3f17dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65, portal: 172.16.0.220,3260]
Aug 15 06:57:27 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65, portal: 172.16.0.220,3260] successful.
Aug 15 06:57:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c00e9a-3605-4bba-88fe-e8da7469ea4d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8898e19-226a-4e1c-b083-df5768a23cff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb16f86-15fb-41c1-9c80-c18b3fadcba1]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-c9d0eea5-f450-4b87-a59f-2ce79821597b req-06f00f1f-d60f-4bbc-9942-3ac32a67b881 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c9d0eea5-f450-4b87-a59f-2ce79821597b req-06f00f1f-d60f-4bbc-9942-3ac32a67b881 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c9d0eea5-f450-4b87-a59f-2ce79821597b req-06f00f1f-d60f-4bbc-9942-3ac32a67b881 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c9d0eea5-f450-4b87-a59f-2ce79821597b req-06f00f1f-d60f-4bbc-9942-3ac32a67b881 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-c9d0eea5-f450-4b87-a59f-2ce79821597b req-06f00f1f-d60f-4bbc-9942-3ac32a67b881 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:28 user nova-compute[72803]: WARNING nova.compute.manager [req-c9d0eea5-f450-4b87-a59f-2ce79821597b req-06f00f1f-d60f-4bbc-9942-3ac32a67b881 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 for instance with vm_state building and task_state spawning.
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNgeDYmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26364326433306438', 'path': '/dev/sdf'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364326433306438', 'path': '/dev/sdf'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUivPTnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:28 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:28 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:28 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[68185cec-7fe5-485a-be52-c48221826178]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:57:28 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbb0415-bc74-4e8e-bc14-33b635cd4ed9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775] added
Aug 15 06:57:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fcf2fb-8d99-4d09-b990-016c78792427]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfc3686-6cb8-45d1-862c-59f7d41a8f1f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUivPTnV {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUivPTnV" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb729fc9-a3af-40c6-8cbd-8f466b928a53]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUivPTnV'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f543827-1c27-40ac-a018-27465e5e42c5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c04ca7-04dd-4281-8f70-189a7b7d282d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18ff6c6-1f5a-4433-90b6-9e77a404dea3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775, portal: 172.16.0.220,3260]
Aug 15 06:57:28 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775, portal: 172.16.0.220,3260] successful.
Aug 15 06:57:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee928503-49f0-4769-940c-be475a9aaa7e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb360e5-26b0-4985-824d-a1dec09f3476]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:57:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[082358f9-61e9-4ee9-bfa9-7c4dbfdb6f83]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-c787fc70-8210-4a0e-8abf-4eaf967f5dba req-986adcb5-fc05-45ce-9a6f-2a90bfd1dc0a service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received event network-changed-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-c787fc70-8210-4a0e-8abf-4eaf967f5dba req-986adcb5-fc05-45ce-9a6f-2a90bfd1dc0a service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Refreshing instance network info cache due to event network-changed-5248eb08-f20c-4c7e-889e-959facbbc988. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c787fc70-8210-4a0e-8abf-4eaf967f5dba req-986adcb5-fc05-45ce-9a6f-2a90bfd1dc0a service nova] Acquiring lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c787fc70-8210-4a0e-8abf-4eaf967f5dba req-986adcb5-fc05-45ce-9a6f-2a90bfd1dc0a service nova] Acquired lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG nova.network.neutron [req-c787fc70-8210-4a0e-8abf-4eaf967f5dba req-986adcb5-fc05-45ce-9a6f-2a90bfd1dc0a service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Refreshing network info cache for port 5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUivPTnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '26465313236303763', 'path': '/dev/sdg'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465313236303763', 'path': '/dev/sdg'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-c787fc70-8210-4a0e-8abf-4eaf967f5dba req-986adcb5-fc05-45ce-9a6f-2a90bfd1dc0a service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updated VIF entry in instance network info cache for port 5248eb08-f20c-4c7e-889e-959facbbc988. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-c787fc70-8210-4a0e-8abf-4eaf967f5dba req-986adcb5-fc05-45ce-9a6f-2a90bfd1dc0a service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updating instance_info_cache with network_info: [{"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b2:28,bridge_name='br-int',has_traffic_filtering=True,id=7ef268dd-8261-4e19-a09e-f1a5ccb4a036,network=Network(22779c3a-8a44-4d1b-b01e-5cc42a4d48e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef268dd-82') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:28:99,bridge_name='br-int',has_traffic_filtering=True,id=fd631e34-2c3b-471f-8e7e-d9b9b3b414e4,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd631e34-2c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0e:40,bridge_name='br-int',has_traffic_filtering=True,id=8fbce24c-1507-4aa3-bbb2-37a5d1513bf6,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fbce24c-15') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:34:7d,bridge_name='br-int',has_traffic_filtering=True,id=bd972609-e9bc-43d8-9c53-629c9a1dba59,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd972609-e9') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:47:fd,bridge_name='br-int',has_traffic_filtering=True,id=31fc1ad3-346b-47a5-b5c9-a34e22ba8c29,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fc1ad3-34') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:92:df,bridge_name='br-int',has_traffic_filtering=True,id=5449c4c2-88f5-492a-9640-c785d926de8b,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5449c4c2-88') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:02:49,bridge_name='br-int',has_traffic_filtering=True,id=5c30b612-476a-4410-8a38-81d20e09e021,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c30b612-47') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.objects.instance [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d3ab35f-ec73-444d-9cc3-e62213f19918 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:57:30 user nova-compute[72803]:   <uuid>7d3ab35f-ec73-444d-9cc3-e62213f19918</uuid>
Aug 15 06:57:30 user nova-compute[72803]:   <name>instance-0000000b</name>
Aug 15 06:57:30 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:57:30 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:57:30 user nova-compute[72803]:   <metadata>
Aug 15 06:57:30 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:57:30 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:57:30 user nova-compute[72803]:       <nova:name>tempest-device-tagging-server-1872284105</nova:name>
Aug 15 06:57:30 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:57:25</nova:creationTime>
Aug 15 06:57:30 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:57:30 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:57:30 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:57:30 user nova-compute[72803]:       <nova:owner>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:user uuid="250cd0a9c2534451a8ddd9cd82a91eae">tempest-TaggedBootDevicesTest_v242-380563655-project-member</nova:user>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:project uuid="6c3be2ca2f3443a2afa55b98f722620d">tempest-TaggedBootDevicesTest_v242-380563655</nova:project>
Aug 15 06:57:30 user nova-compute[72803]:       </nova:owner>
Aug 15 06:57:30 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:57:30 user nova-compute[72803]:       <nova:ports>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:port uuid="7ef268dd-8261-4e19-a09e-f1a5ccb4a036">
Aug 15 06:57:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 06:57:30 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:port uuid="fd631e34-2c3b-471f-8e7e-d9b9b3b414e4">
Aug 15 06:57:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Aug 15 06:57:30 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:port uuid="8fbce24c-1507-4aa3-bbb2-37a5d1513bf6">
Aug 15 06:57:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
Aug 15 06:57:30 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:port uuid="bd972609-e9bc-43d8-9c53-629c9a1dba59">
Aug 15 06:57:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Aug 15 06:57:30 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:port uuid="31fc1ad3-346b-47a5-b5c9-a34e22ba8c29">
Aug 15 06:57:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Aug 15 06:57:30 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:port uuid="5449c4c2-88f5-492a-9640-c785d926de8b">
Aug 15 06:57:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 06:57:30 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:30 user nova-compute[72803]:         <nova:port uuid="5c30b612-476a-4410-8a38-81d20e09e021">
Aug 15 06:57:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 06:57:30 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:30 user nova-compute[72803]:       </nova:ports>
Aug 15 06:57:30 user nova-compute[72803]:     </nova:instance>
Aug 15 06:57:30 user nova-compute[72803]:   </metadata>
Aug 15 06:57:30 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:57:30 user nova-compute[72803]:     <system>
Aug 15 06:57:30 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:57:30 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:57:30 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:57:30 user nova-compute[72803]:       <entry name="serial">7d3ab35f-ec73-444d-9cc3-e62213f19918</entry>
Aug 15 06:57:30 user nova-compute[72803]:       <entry name="uuid">7d3ab35f-ec73-444d-9cc3-e62213f19918</entry>
Aug 15 06:57:30 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:57:30 user nova-compute[72803]:     </system>
Aug 15 06:57:30 user nova-compute[72803]:   </sysinfo>
Aug 15 06:57:30 user nova-compute[72803]:   <os>
Aug 15 06:57:30 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:57:30 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:57:30 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:57:30 user nova-compute[72803]:   </os>
Aug 15 06:57:30 user nova-compute[72803]:   <features>
Aug 15 06:57:30 user nova-compute[72803]:     <acpi/>
Aug 15 06:57:30 user nova-compute[72803]:     <apic/>
Aug 15 06:57:30 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:57:30 user nova-compute[72803]:   </features>
Aug 15 06:57:30 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:57:30 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:57:30 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:57:30 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:57:30 user nova-compute[72803]:   </clock>
Aug 15 06:57:30 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:57:30 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:57:30 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:57:30 user nova-compute[72803]:   </cpu>
Aug 15 06:57:30 user nova-compute[72803]:   <devices>
Aug 15 06:57:30 user nova-compute[72803]:     <disk type="file" device="cdrom">
Aug 15 06:57:30 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 06:57:30 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/7d3ab35f-ec73-444d-9cc3-e62213f19918/disk.config"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="hda" bus="ide"/>
Aug 15 06:57:30 user nova-compute[72803]:     </disk>
Aug 15 06:57:30 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 06:57:30 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:57:30 user nova-compute[72803]:       <source dev="/dev/sde"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <serial>df43cefc-ab8e-4217-9f9a-60280056a282</serial>
Aug 15 06:57:30 user nova-compute[72803]:     </disk>
Aug 15 06:57:30 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 06:57:30 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:57:30 user nova-compute[72803]:       <source dev="/dev/sdf"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <serial>48a11f13-ce2f-4abb-8864-e8b2a19d5a65</serial>
Aug 15 06:57:30 user nova-compute[72803]:     </disk>
Aug 15 06:57:30 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 06:57:30 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:57:30 user nova-compute[72803]:       <source dev="/dev/sdg"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="vdc" bus="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <serial>64e5a6aa-1301-42fd-b80f-a32376121775</serial>
Aug 15 06:57:30 user nova-compute[72803]:     </disk>
Aug 15 06:57:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:30 user nova-compute[72803]:       <mac address="fa:16:3e:08:b2:28"/>
Aug 15 06:57:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="tap7ef268dd-82"/>
Aug 15 06:57:30 user nova-compute[72803]:     </interface>
Aug 15 06:57:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:30 user nova-compute[72803]:       <mac address="fa:16:3e:95:28:99"/>
Aug 15 06:57:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="tapfd631e34-2c"/>
Aug 15 06:57:30 user nova-compute[72803]:     </interface>
Aug 15 06:57:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:30 user nova-compute[72803]:       <mac address="fa:16:3e:1f:0e:40"/>
Aug 15 06:57:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="tap8fbce24c-15"/>
Aug 15 06:57:30 user nova-compute[72803]:     </interface>
Aug 15 06:57:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:30 user nova-compute[72803]:       <mac address="fa:16:3e:d6:34:7d"/>
Aug 15 06:57:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="tapbd972609-e9"/>
Aug 15 06:57:30 user nova-compute[72803]:     </interface>
Aug 15 06:57:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:30 user nova-compute[72803]:       <mac address="fa:16:3e:aa:47:fd"/>
Aug 15 06:57:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="tap31fc1ad3-34"/>
Aug 15 06:57:30 user nova-compute[72803]:     </interface>
Aug 15 06:57:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:30 user nova-compute[72803]:       <mac address="fa:16:3e:5a:92:df"/>
Aug 15 06:57:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="tap5449c4c2-88"/>
Aug 15 06:57:30 user nova-compute[72803]:     </interface>
Aug 15 06:57:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:30 user nova-compute[72803]:       <mac address="fa:16:3e:cc:02:49"/>
Aug 15 06:57:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:30 user nova-compute[72803]:       <target dev="tap5c30b612-47"/>
Aug 15 06:57:30 user nova-compute[72803]:     </interface>
Aug 15 06:57:30 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:57:30 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/7d3ab35f-ec73-444d-9cc3-e62213f19918/console.log" append="off"/>
Aug 15 06:57:30 user nova-compute[72803]:     </serial>
Aug 15 06:57:30 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:57:30 user nova-compute[72803]:     <video>
Aug 15 06:57:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:30 user nova-compute[72803]:     </video>
Aug 15 06:57:30 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:57:30 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:57:30 user nova-compute[72803]:     </rng>
Aug 15 06:57:30 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:57:30 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:57:30 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:57:30 user nova-compute[72803]:     </memballoon>
Aug 15 06:57:30 user nova-compute[72803]:   </devices>
Aug 15 06:57:30 user nova-compute[72803]: </domain>
Aug 15 06:57:30 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b2:28,bridge_name='br-int',has_traffic_filtering=True,id=7ef268dd-8261-4e19-a09e-f1a5ccb4a036,network=Network(22779c3a-8a44-4d1b-b01e-5cc42a4d48e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef268dd-82') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b2:28,bridge_name='br-int',has_traffic_filtering=True,id=7ef268dd-8261-4e19-a09e-f1a5ccb4a036,network=Network(22779c3a-8a44-4d1b-b01e-5cc42a4d48e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef268dd-82') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c787fc70-8210-4a0e-8abf-4eaf967f5dba req-986adcb5-fc05-45ce-9a6f-2a90bfd1dc0a service nova] Releasing lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ef268dd-82, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ef268dd-82, col_values=(('external_ids', {'iface-id': '7ef268dd-8261-4e19-a09e-f1a5ccb4a036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:b2:28', 'vm-uuid': '7d3ab35f-ec73-444d-9cc3-e62213f19918'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: INFO os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b2:28,bridge_name='br-int',has_traffic_filtering=True,id=7ef268dd-8261-4e19-a09e-f1a5ccb4a036,network=Network(22779c3a-8a44-4d1b-b01e-5cc42a4d48e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef268dd-82')
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:28:99,bridge_name='br-int',has_traffic_filtering=True,id=fd631e34-2c3b-471f-8e7e-d9b9b3b414e4,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd631e34-2c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:28:99,bridge_name='br-int',has_traffic_filtering=True,id=fd631e34-2c3b-471f-8e7e-d9b9b3b414e4,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd631e34-2c') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd631e34-2c, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd631e34-2c, col_values=(('external_ids', {'iface-id': 'fd631e34-2c3b-471f-8e7e-d9b9b3b414e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:28:99', 'vm-uuid': '7d3ab35f-ec73-444d-9cc3-e62213f19918'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: INFO os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:28:99,bridge_name='br-int',has_traffic_filtering=True,id=fd631e34-2c3b-471f-8e7e-d9b9b3b414e4,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd631e34-2c')
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0e:40,bridge_name='br-int',has_traffic_filtering=True,id=8fbce24c-1507-4aa3-bbb2-37a5d1513bf6,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fbce24c-15') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0e:40,bridge_name='br-int',has_traffic_filtering=True,id=8fbce24c-1507-4aa3-bbb2-37a5d1513bf6,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fbce24c-15') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fbce24c-15, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fbce24c-15, col_values=(('external_ids', {'iface-id': '8fbce24c-1507-4aa3-bbb2-37a5d1513bf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:0e:40', 'vm-uuid': '7d3ab35f-ec73-444d-9cc3-e62213f19918'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:30 user nova-compute[72803]: WARNING nova.compute.manager [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 for instance with vm_state building and task_state spawning.
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-changed-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Refreshing instance network info cache due to event network-changed-01af57c9-c09e-45b8-8ba5-c90a6c729ec9. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Acquiring lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Acquired lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Refreshing network info cache for port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: INFO os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0e:40,bridge_name='br-int',has_traffic_filtering=True,id=8fbce24c-1507-4aa3-bbb2-37a5d1513bf6,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fbce24c-15')
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:34:7d,bridge_name='br-int',has_traffic_filtering=True,id=bd972609-e9bc-43d8-9c53-629c9a1dba59,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd972609-e9') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:34:7d,bridge_name='br-int',has_traffic_filtering=True,id=bd972609-e9bc-43d8-9c53-629c9a1dba59,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd972609-e9') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd972609-e9, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd972609-e9, col_values=(('external_ids', {'iface-id': 'bd972609-e9bc-43d8-9c53-629c9a1dba59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:34:7d', 'vm-uuid': '7d3ab35f-ec73-444d-9cc3-e62213f19918'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: INFO os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:34:7d,bridge_name='br-int',has_traffic_filtering=True,id=bd972609-e9bc-43d8-9c53-629c9a1dba59,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd972609-e9')
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:47:fd,bridge_name='br-int',has_traffic_filtering=True,id=31fc1ad3-346b-47a5-b5c9-a34e22ba8c29,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fc1ad3-34') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:47:fd,bridge_name='br-int',has_traffic_filtering=True,id=31fc1ad3-346b-47a5-b5c9-a34e22ba8c29,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fc1ad3-34') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31fc1ad3-34, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31fc1ad3-34, col_values=(('external_ids', {'iface-id': '31fc1ad3-346b-47a5-b5c9-a34e22ba8c29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:47:fd', 'vm-uuid': '7d3ab35f-ec73-444d-9cc3-e62213f19918'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: INFO os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:47:fd,bridge_name='br-int',has_traffic_filtering=True,id=31fc1ad3-346b-47a5-b5c9-a34e22ba8c29,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fc1ad3-34')
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:92:df,bridge_name='br-int',has_traffic_filtering=True,id=5449c4c2-88f5-492a-9640-c785d926de8b,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5449c4c2-88') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:92:df,bridge_name='br-int',has_traffic_filtering=True,id=5449c4c2-88f5-492a-9640-c785d926de8b,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5449c4c2-88') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5449c4c2-88, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5449c4c2-88, col_values=(('external_ids', {'iface-id': '5449c4c2-88f5-492a-9640-c785d926de8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:92:df', 'vm-uuid': '7d3ab35f-ec73-444d-9cc3-e62213f19918'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: INFO os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:92:df,bridge_name='br-int',has_traffic_filtering=True,id=5449c4c2-88f5-492a-9640-c785d926de8b,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5449c4c2-88')
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:02:49,bridge_name='br-int',has_traffic_filtering=True,id=5c30b612-476a-4410-8a38-81d20e09e021,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c30b612-47') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:02:49,bridge_name='br-int',has_traffic_filtering=True,id=5c30b612-476a-4410-8a38-81d20e09e021,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c30b612-47') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c30b612-47, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c30b612-47, col_values=(('external_ids', {'iface-id': '5c30b612-476a-4410-8a38-81d20e09e021', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:02:49', 'vm-uuid': '7d3ab35f-ec73-444d-9cc3-e62213f19918'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:30 user nova-compute[72803]: INFO os_vif [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:02:49,bridge_name='br-int',has_traffic_filtering=True,id=5c30b612-476a-4410-8a38-81d20e09e021,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c30b612-47')
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-7e6d7885-83a3-4232-b134-0967bd7855cb req-94fda05f-4c3e-42ae-9709-bf4801788927 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7e6d7885-83a3-4232-b134-0967bd7855cb req-94fda05f-4c3e-42ae-9709-bf4801788927 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7e6d7885-83a3-4232-b134-0967bd7855cb req-94fda05f-4c3e-42ae-9709-bf4801788927 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7e6d7885-83a3-4232-b134-0967bd7855cb req-94fda05f-4c3e-42ae-9709-bf4801788927 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-7e6d7885-83a3-4232-b134-0967bd7855cb req-94fda05f-4c3e-42ae-9709-bf4801788927 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:30 user nova-compute[72803]: WARNING nova.compute.manager [req-7e6d7885-83a3-4232-b134-0967bd7855cb req-94fda05f-4c3e-42ae-9709-bf4801788927 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 for instance with vm_state building and task_state spawning.
Aug 15 06:57:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] No BDM found with device name hda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] No VIF found with MAC fa:16:3e:08:b2:28, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] No VIF found with MAC fa:16:3e:aa:47:fd, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:57:31 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Using config drive
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.network.neutron [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updated VIF entry in instance network info cache for port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.network.neutron [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Releasing lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:31 user nova-compute[72803]: WARNING nova.compute.manager [req-88dc741c-283b-49c6-a9a5-4cd9dcd83afa req-27c09e0f-a86b-4e00-a40c-53232b665ba7 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a for instance with vm_state building and task_state spawning.
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:31 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Creating config drive at /opt/stack/data/nova/instances/7d3ab35f-ec73-444d-9cc3-e62213f19918/disk.config
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d3ab35f-ec73-444d-9cc3-e62213f19918/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9jdke66v {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d3ab35f-ec73-444d-9cc3-e62213f19918/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9jdke66v" returned: 0 in 0.095s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082651.5676858, cec4b0a2-dcfd-418e-af89-d0289651dd0d => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:57:31 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] VM Resumed (Lifecycle Event)
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:31 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance spawned successfully.
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:31 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082651.5679605, cec4b0a2-dcfd-418e-af89-d0289651dd0d => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:57:31 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] VM Started (Lifecycle Event)
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:57:31 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:57:31 user nova-compute[72803]: INFO nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Took 11.10 seconds to spawn the instance on the hypervisor.
Aug 15 06:57:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:32 user nova-compute[72803]: INFO nova.compute.manager [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Took 43.14 seconds to build instance.
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6b8e6452-1302-4fe7-af27-f99dcc70a790 tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.281s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:32 user nova-compute[72803]: WARNING nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a for instance with vm_state active and task_state None.
Aug 15 06:57:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:32 user nova-compute[72803]: WARNING nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b for instance with vm_state active and task_state None.
Aug 15 06:57:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:32 user nova-compute[72803]: WARNING nova.compute.manager [req-35615407-1969-4bfc-b3f8-283c14b251e2 req-5793f056-1b7d-46af-9c3b-5deab3b27b5b service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b for instance with vm_state active and task_state None.
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-changed-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Refreshing instance network info cache due to event network-changed-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquiring lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquired lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG nova.network.neutron [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Refreshing network info cache for port d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:57:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:57:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:57:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.network.neutron [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updated VIF entry in instance network info cache for port d6a1c323-0e6e-4be7-a45d-d26e3ac2d718. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.network.neutron [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082657.3623219, 7d3ab35f-ec73-444d-9cc3-e62213f19918 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:57:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] VM Resumed (Lifecycle Event)
Aug 15 06:57:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:57:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance spawned successfully.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7073MB free_disk=25.68380355834961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.objects.instance [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid ff252c72-caf0-4c90-b078-6aab5a0b1fab {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082657.3634264, 7d3ab35f-ec73-444d-9cc3-e62213f19918 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:57:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] VM Started (Lifecycle Event)
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Releasing lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 for instance with vm_state active and task_state None.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a for instance with vm_state active and task_state None.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a for instance with vm_state active and task_state None.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 for instance with vm_state active and task_state None.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 for instance with vm_state active and task_state None.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 for instance with vm_state active and task_state None.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:37 user nova-compute[72803]: WARNING nova.compute.manager [req-6400bf63-c54e-42b3-bc7c-5b388951dc9d req-e702a81f-fe12-4330-ba10-d16846d5c467 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 for instance with vm_state active and task_state None.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:37 user nova-compute[72803]: INFO nova.compute.manager [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Shelving
Aug 15 06:57:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:57:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:57:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.193s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:38 user nova-compute[72803]: INFO nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Took 12.39 seconds to spawn the instance on the hypervisor.
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 454ea345-aaa5-423b-add3-20a933978eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ff252c72-caf0-4c90-b078-6aab5a0b1fab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c94b60f1-bfc1-488a-9c12-255a15a29002 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 2daeef6a-2d82-4d18-94ec-11fce8ed7479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f015c02e-e530-4ec9-9fac-6efad4535956 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance cec4b0a2-dcfd-418e-af89-d0289651dd0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 7d3ab35f-ec73-444d-9cc3-e62213f19918 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:38 user nova-compute[72803]: INFO nova.compute.manager [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Took 42.93 seconds to build instance.
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-af0b8f28-76e8-495d-a46b-93fc0fdc154e tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.047s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:38 user nova-compute[72803]: INFO nova.compute.manager [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Attaching volume 7339a01d-8222-4c04-ba6e-4634c6bfbdca to /dev/vdb
Aug 15 06:57:38 user nova-compute[72803]: DEBUG os_brick.utils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bbcbc0-3118-4d52-adb6-61706b8b7baa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e04698-0718-43b0-bfa8-378a23d0de8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.manager [req-2872d751-3a46-4a95-a485-b578534ff706 req-99af94c2-f76a-42a0-9870-848d98570b0d service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2872d751-3a46-4a95-a485-b578534ff706 req-99af94c2-f76a-42a0-9870-848d98570b0d service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2872d751-3a46-4a95-a485-b578534ff706 req-99af94c2-f76a-42a0-9870-848d98570b0d service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2872d751-3a46-4a95-a485-b578534ff706 req-99af94c2-f76a-42a0-9870-848d98570b0d service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.manager [req-2872d751-3a46-4a95-a485-b578534ff706 req-99af94c2-f76a-42a0-9870-848d98570b0d service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:38 user nova-compute[72803]: WARNING nova.compute.manager [req-2872d751-3a46-4a95-a485-b578534ff706 req-99af94c2-f76a-42a0-9870-848d98570b0d service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 for instance with vm_state active and task_state None.
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf4aead-24fd-42a4-ade9-28678b0509eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2dc338-4d32-4e8b-b0ac-cdead0ced5c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:38 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0432ef73-3e9d-4189-aee6-a90e91119455]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG os_brick.utils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updating existing volume attachment record: 585cf0ec-9ca7-4dcd-a77f-3d825f958079 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.860s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.625s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:57:38 user nova-compute[72803]: INFO nova.compute.claims [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Claim successful on node user
Aug 15 06:57:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance destroyed successfully.
Aug 15 06:57:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Beginning cold snapshot process
Aug 15 06:57:39 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 06:57:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk /opt/stack/data/nova/instances/snapshots/tmpj3z3wxdf/107c1cd10938469a9e9253cefa679e72 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:39 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:57:39 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:57:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:57:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.012s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:57:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:57:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:57:39 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:57:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk /opt/stack/data/nova/instances/snapshots/tmpj3z3wxdf/107c1cd10938469a9e9253cefa679e72" returned: 0 in 0.952s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:40 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Snapshot extracted, beginning image upload
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.policy [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f4e9b6b9aee48bea69d3e9deec0c6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc1dffbf0c34ee7bdf7709deb144a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:57:40 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Creating image(s)
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "/opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "/opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:40 user nova-compute[72803]: WARNING nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 for instance with vm_state active and task_state None.
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:40 user nova-compute[72803]: WARNING nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 for instance with vm_state active and task_state None.
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:40 user nova-compute[72803]: WARNING nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 for instance with vm_state active and task_state None.
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:40 user nova-compute[72803]: WARNING nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 for instance with vm_state active and task_state None.
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:40 user nova-compute[72803]: WARNING nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 for instance with vm_state active and task_state None.
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:40 user nova-compute[72803]: WARNING nova.compute.manager [req-e7d64258-9452-444a-92cf-a1c8bbf76b80 req-0163b218-ff4d-4a26-ba19-be565259b5ba service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 for instance with vm_state active and task_state None.
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.223s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk 1073741824" returned: 0 in 0.056s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.227s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:40 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Successfully created port: 20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Cannot resize image /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lazy-loading 'migration_context' on Instance uuid 5fb89ce0-1cc3-4a6a-b812-c889f302584e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Ensure instance console log exists: /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Successfully updated port: 20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquired lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.compute.manager [req-d1bfaf28-d4f0-40ef-b555-802d62c99454 req-505d8a4c-86d6-4893-90c8-b99192f49c58 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received event network-changed-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.compute.manager [req-d1bfaf28-d4f0-40ef-b555-802d62c99454 req-505d8a4c-86d6-4893-90c8-b99192f49c58 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Refreshing instance network info cache due to event network-changed-20ffd8c7-29f1-458c-b57b-fdf407ba0446. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d1bfaf28-d4f0-40ef-b555-802d62c99454 req-505d8a4c-86d6-4893-90c8-b99192f49c58 service nova] Acquiring lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:41 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Updating instance_info_cache with network_info: [{"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Releasing lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Instance network_info: |[{"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d1bfaf28-d4f0-40ef-b555-802d62c99454 req-505d8a4c-86d6-4893-90c8-b99192f49c58 service nova] Acquired lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.network.neutron [req-d1bfaf28-d4f0-40ef-b555-802d62c99454 req-505d8a4c-86d6-4893-90c8-b99192f49c58 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Refreshing network info cache for port 20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Start _get_guest_xml network_info=[{"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410094081',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410094081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1410094',id=12,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7QWh4EhPR7g5HQz2bjRHymmrXr02AZUNfuDs+w2WYhc1mMECA/XmBMYTNz1FepsCJU480SnoC/6BjLSNynN+hV9BDFo4KY6p5z3InuHXgl9XMDM0/UIsASdA+XLAaxmw==',key_name='tempest-keypair-1835645749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc1dffbf0c34ee7bdf7709deb144a46',ramdisk_id='',reservation_id='r-2ojuy0t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-929362686',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4e9b6b9aee48bea69d3e9deec0c6d8',uuid=5fb89ce0-1cc3-4a6a-b812-c889f302584e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Converting VIF {"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=20ffd8c7-29f1-458c-b57b-fdf407ba0446,network=Network(5bc0a579-69ef-4495-a71a-c9bdd0c40777),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ffd8c7-29') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fb89ce0-1cc3-4a6a-b812-c889f302584e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:57:42 user nova-compute[72803]:   <uuid>5fb89ce0-1cc3-4a6a-b812-c889f302584e</uuid>
Aug 15 06:57:42 user nova-compute[72803]:   <name>instance-0000000c</name>
Aug 15 06:57:42 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:57:42 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:57:42 user nova-compute[72803]:   <metadata>
Aug 15 06:57:42 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:57:42 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:57:42 user nova-compute[72803]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1410094081</nova:name>
Aug 15 06:57:42 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:57:42</nova:creationTime>
Aug 15 06:57:42 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:57:42 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:57:42 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:57:42 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:57:42 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:57:42 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:57:42 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:57:42 user nova-compute[72803]:       <nova:owner>
Aug 15 06:57:42 user nova-compute[72803]:         <nova:user uuid="9f4e9b6b9aee48bea69d3e9deec0c6d8">tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member</nova:user>
Aug 15 06:57:42 user nova-compute[72803]:         <nova:project uuid="dbc1dffbf0c34ee7bdf7709deb144a46">tempest-TestServerVolumeAttachScenarioOldVersion-929362686</nova:project>
Aug 15 06:57:42 user nova-compute[72803]:       </nova:owner>
Aug 15 06:57:42 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:57:42 user nova-compute[72803]:       <nova:ports>
Aug 15 06:57:42 user nova-compute[72803]:         <nova:port uuid="20ffd8c7-29f1-458c-b57b-fdf407ba0446">
Aug 15 06:57:42 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 06:57:42 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:42 user nova-compute[72803]:       </nova:ports>
Aug 15 06:57:42 user nova-compute[72803]:     </nova:instance>
Aug 15 06:57:42 user nova-compute[72803]:   </metadata>
Aug 15 06:57:42 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:57:42 user nova-compute[72803]:     <system>
Aug 15 06:57:42 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:57:42 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:57:42 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:57:42 user nova-compute[72803]:       <entry name="serial">5fb89ce0-1cc3-4a6a-b812-c889f302584e</entry>
Aug 15 06:57:42 user nova-compute[72803]:       <entry name="uuid">5fb89ce0-1cc3-4a6a-b812-c889f302584e</entry>
Aug 15 06:57:42 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:57:42 user nova-compute[72803]:     </system>
Aug 15 06:57:42 user nova-compute[72803]:   </sysinfo>
Aug 15 06:57:42 user nova-compute[72803]:   <os>
Aug 15 06:57:42 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:57:42 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:57:42 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:57:42 user nova-compute[72803]:   </os>
Aug 15 06:57:42 user nova-compute[72803]:   <features>
Aug 15 06:57:42 user nova-compute[72803]:     <acpi/>
Aug 15 06:57:42 user nova-compute[72803]:     <apic/>
Aug 15 06:57:42 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:57:42 user nova-compute[72803]:   </features>
Aug 15 06:57:42 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:57:42 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:57:42 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:57:42 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:57:42 user nova-compute[72803]:   </clock>
Aug 15 06:57:42 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:57:42 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:57:42 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:57:42 user nova-compute[72803]:   </cpu>
Aug 15 06:57:42 user nova-compute[72803]:   <devices>
Aug 15 06:57:42 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:57:42 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:57:42 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk"/>
Aug 15 06:57:42 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:57:42 user nova-compute[72803]:     </disk>
Aug 15 06:57:42 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:42 user nova-compute[72803]:       <mac address="fa:16:3e:8e:16:40"/>
Aug 15 06:57:42 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:42 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:42 user nova-compute[72803]:       <target dev="tap20ffd8c7-29"/>
Aug 15 06:57:42 user nova-compute[72803]:     </interface>
Aug 15 06:57:42 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:57:42 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/console.log" append="off"/>
Aug 15 06:57:42 user nova-compute[72803]:     </serial>
Aug 15 06:57:42 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:57:42 user nova-compute[72803]:     <video>
Aug 15 06:57:42 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:42 user nova-compute[72803]:     </video>
Aug 15 06:57:42 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:57:42 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:57:42 user nova-compute[72803]:     </rng>
Aug 15 06:57:42 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:57:42 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:57:42 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:57:42 user nova-compute[72803]:     </memballoon>
Aug 15 06:57:42 user nova-compute[72803]:   </devices>
Aug 15 06:57:42 user nova-compute[72803]: </domain>
Aug 15 06:57:42 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410094081',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410094081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1410094',id=12,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7QWh4EhPR7g5HQz2bjRHymmrXr02AZUNfuDs+w2WYhc1mMECA/XmBMYTNz1FepsCJU480SnoC/6BjLSNynN+hV9BDFo4KY6p5z3InuHXgl9XMDM0/UIsASdA+XLAaxmw==',key_name='tempest-keypair-1835645749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbc1dffbf0c34ee7bdf7709deb144a46',ramdisk_id='',reservation_id='r-2ojuy0t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-929362686',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4e9b6b9aee48bea69d3e9deec0c6d8',uuid=5fb89ce0-1cc3-4a6a-b812-c889f302584e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Converting VIF {"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=20ffd8c7-29f1-458c-b57b-fdf407ba0446,network=Network(5bc0a579-69ef-4495-a71a-c9bdd0c40777),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ffd8c7-29') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG os_vif [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=20ffd8c7-29f1-458c-b57b-fdf407ba0446,network=Network(5bc0a579-69ef-4495-a71a-c9bdd0c40777),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ffd8c7-29') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20ffd8c7-29, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20ffd8c7-29, col_values=(('external_ids', {'iface-id': '20ffd8c7-29f1-458c-b57b-fdf407ba0446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:16:40', 'vm-uuid': '5fb89ce0-1cc3-4a6a-b812-c889f302584e'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:42 user nova-compute[72803]: INFO os_vif [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=20ffd8c7-29f1-458c-b57b-fdf407ba0446,network=Network(5bc0a579-69ef-4495-a71a-c9bdd0c40777),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ffd8c7-29')
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] No VIF found with MAC fa:16:3e:8e:16:40, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 for instance with vm_state active and task_state None.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 for instance with vm_state active and task_state None.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 for instance with vm_state active and task_state None.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b for instance with vm_state active and task_state None.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b for instance with vm_state active and task_state None.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 for instance with vm_state active and task_state None.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 for instance with vm_state active and task_state None.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-unplugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] No waiting events found dispatching network-vif-unplugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received unexpected event network-vif-unplugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] No waiting events found dispatching network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:42 user nova-compute[72803]: WARNING nova.compute.manager [req-2782c85a-eb6f-45ad-9acb-3fdc3fbac3bb req-5675ad2f-192c-474d-9824-939fed9e94cd service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received unexpected event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.network.neutron [req-d1bfaf28-d4f0-40ef-b555-802d62c99454 req-505d8a4c-86d6-4893-90c8-b99192f49c58 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Updated VIF entry in instance network info cache for port 20ffd8c7-29f1-458c-b57b-fdf407ba0446. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG nova.network.neutron [req-d1bfaf28-d4f0-40ef-b555-802d62c99454 req-505d8a4c-86d6-4893-90c8-b99192f49c58 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Updating instance_info_cache with network_info: [{"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d1bfaf28-d4f0-40ef-b555-802d62c99454 req-505d8a4c-86d6-4893-90c8-b99192f49c58 service nova] Releasing lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Snapshot image upload complete
Aug 15 06:57:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:43 user nova-compute[72803]: INFO nova.compute.manager [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Shelve offloading
Aug 15 06:57:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance destroyed successfully.
Aug 15 06:57:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquired lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:43 user nova-compute[72803]: DEBUG nova.network.neutron [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:57:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:43 user nova-compute[72803]: DEBUG nova.network.neutron [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Releasing lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance destroyed successfully.
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'resources' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1152789104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1152789104',id=2,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyuK0T+jZdeRbyAIRejk7h3Ml+YmKlkGNdFeM7qM3Ug6lUIK5jXhgYrxd4X/ihahxzn/CahnDI1epyjgQifpsf5mhRksc8sd/Cf/kMl3QRRbB6UOkZUEN18an3vjOJoQw==',key_name='tempest-keypair-577174082',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-11vl8r1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member',shelved_at='2023-08-15T06:57:43.118617',shelved_host='user',shelved_image_id='6f17a691-57f0-4d30-a577-227d2eeb57e7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=454ea345-aaa5-423b-add3-20a933978eec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG os_vif [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-a60c4c8f-619d-4fb6-8bc0-6a3d5b1ad186 req-20cb3382-be0e-4d0c-be45-29ee3dbaba8b service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-changed-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-a60c4c8f-619d-4fb6-8bc0-6a3d5b1ad186 req-20cb3382-be0e-4d0c-be45-29ee3dbaba8b service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Refreshing instance network info cache due to event network-changed-01af57c9-c09e-45b8-8ba5-c90a6c729ec9. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a60c4c8f-619d-4fb6-8bc0-6a3d5b1ad186 req-20cb3382-be0e-4d0c-be45-29ee3dbaba8b service nova] Acquiring lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a60c4c8f-619d-4fb6-8bc0-6a3d5b1ad186 req-20cb3382-be0e-4d0c-be45-29ee3dbaba8b service nova] Acquired lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.network.neutron [req-a60c4c8f-619d-4fb6-8bc0-6a3d5b1ad186 req-20cb3382-be0e-4d0c-be45-29ee3dbaba8b service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Refreshing network info cache for port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01af57c9-c0, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-576f6969-5ce7-440d-9b97-11513a120cc5 req-6b8ec57c-0bed-47e0-bf6a-a4aa5e723692 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received event network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-576f6969-5ce7-440d-9b97-11513a120cc5 req-6b8ec57c-0bed-47e0-bf6a-a4aa5e723692 service nova] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-576f6969-5ce7-440d-9b97-11513a120cc5 req-6b8ec57c-0bed-47e0-bf6a-a4aa5e723692 service nova] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-576f6969-5ce7-440d-9b97-11513a120cc5 req-6b8ec57c-0bed-47e0-bf6a-a4aa5e723692 service nova] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-576f6969-5ce7-440d-9b97-11513a120cc5 req-6b8ec57c-0bed-47e0-bf6a-a4aa5e723692 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] No waiting events found dispatching network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:44 user nova-compute[72803]: WARNING nova.compute.manager [req-576f6969-5ce7-440d-9b97-11513a120cc5 req-6b8ec57c-0bed-47e0-bf6a-a4aa5e723692 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received unexpected event network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 for instance with vm_state building and task_state spawning.
Aug 15 06:57:44 user nova-compute[72803]: INFO os_vif [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0')
Aug 15 06:57:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Deleting instance files /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec_del
Aug 15 06:57:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Deletion of /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec_del complete
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:44 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Deleted allocations for instance 454ea345-aaa5-423b-add3-20a933978eec
Aug 15 06:57:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG nova.objects.instance [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'numa_topology' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG nova.network.neutron [req-a60c4c8f-619d-4fb6-8bc0-6a3d5b1ad186 req-20cb3382-be0e-4d0c-be45-29ee3dbaba8b service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updated VIF entry in instance network info cache for port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG nova.network.neutron [req-a60c4c8f-619d-4fb6-8bc0-6a3d5b1ad186 req-20cb3382-be0e-4d0c-be45-29ee3dbaba8b service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap01af57c9-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a60c4c8f-619d-4fb6-8bc0-6a3d5b1ad186 req-20cb3382-be0e-4d0c-be45-29ee3dbaba8b service nova] Releasing lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df1bb937-80a5-4f88-bba0-8b4d4269667a tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.664s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082666.5628405, 5fb89ce0-1cc3-4a6a-b812-c889f302584e => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:57:46 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] VM Resumed (Lifecycle Event)
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:57:46 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Instance spawned successfully.
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:57:46 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082666.5639746, 5fb89ce0-1cc3-4a6a-b812-c889f302584e => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:57:46 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] VM Started (Lifecycle Event)
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:57:46 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:57:46 user nova-compute[72803]: INFO nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Took 6.52 seconds to spawn the instance on the hypervisor.
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:46 user nova-compute[72803]: INFO nova.compute.manager [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Took 8.73 seconds to build instance.
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-09024c8e-5adb-4e46-96fc-bed16ccb2ffe req-e48a0e7d-8beb-405d-947c-16f436c8b177 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received event network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09024c8e-5adb-4e46-96fc-bed16ccb2ffe req-e48a0e7d-8beb-405d-947c-16f436c8b177 service nova] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09024c8e-5adb-4e46-96fc-bed16ccb2ffe req-e48a0e7d-8beb-405d-947c-16f436c8b177 service nova] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09024c8e-5adb-4e46-96fc-bed16ccb2ffe req-e48a0e7d-8beb-405d-947c-16f436c8b177 service nova] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-09024c8e-5adb-4e46-96fc-bed16ccb2ffe req-e48a0e7d-8beb-405d-947c-16f436c8b177 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] No waiting events found dispatching network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:57:46 user nova-compute[72803]: WARNING nova.compute.manager [req-09024c8e-5adb-4e46-96fc-bed16ccb2ffe req-e48a0e7d-8beb-405d-947c-16f436c8b177 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received unexpected event network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 for instance with vm_state active and task_state None.
Aug 15 06:57:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b84532ab-6f02-4611-8875-baeb99127a32 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.997s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hslLRqNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:50 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:50 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:57:50 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6cfe79-b38e-4f2a-9658-e9de9c6277bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:57:50 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b314e31e-cb99-4ff8-af80-22cf1f67bc98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca] added
Aug 15 06:57:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded6197b-a87e-4cbf-9531-ece6bae85273]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c5c7e2-1dc6-4b3f-b77d-bc18cde55b00]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hslLRqNX {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hslLRqNX" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3a0fb6-55c8-4085-8213-110df4ee94aa]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hslLRqNX'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[61451ee4-d238-4e1e-b358-9629cc88b592]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d001f9-1f03-4849-9b3a-b2f3bd5b3243]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-a910cc59-7736-403e-a066-eeb3fd104f9d req-2246a1f4-eea4-4dd8-bbdf-0a2eb6164748 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received event network-changed-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-a910cc59-7736-403e-a066-eeb3fd104f9d req-2246a1f4-eea4-4dd8-bbdf-0a2eb6164748 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Refreshing instance network info cache due to event network-changed-d9a98be4-bb66-4f3f-a354-5a1767c3c891. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a910cc59-7736-403e-a066-eeb3fd104f9d req-2246a1f4-eea4-4dd8-bbdf-0a2eb6164748 service nova] Acquiring lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a910cc59-7736-403e-a066-eeb3fd104f9d req-2246a1f4-eea4-4dd8-bbdf-0a2eb6164748 service nova] Acquired lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-a910cc59-7736-403e-a066-eeb3fd104f9d req-2246a1f4-eea4-4dd8-bbdf-0a2eb6164748 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Refreshing network info cache for port d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7245b1c-1b6b-436a-a4fa-459606df8563]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca, portal: 172.16.0.220,3260]
Aug 15 06:57:50 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca, portal: 172.16.0.220,3260] successful.
Aug 15 06:57:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a481526c-536d-4416-8005-737520db0441]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f699bf9d-e5d0-4fdf-bfcd-0c6234e078bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:57:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:57:50 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:57:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c2eba8-d1a6-4c08-976a-8016dd05fc91]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hslLRqNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-7dd212ba-6815-460f-a10a-86173493fcc1 req-3c6bbe08-2af2-49c6-834f-21a6c8e6026b service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received event network-changed-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-7dd212ba-6815-460f-a10a-86173493fcc1 req-3c6bbe08-2af2-49c6-834f-21a6c8e6026b service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Refreshing instance network info cache due to event network-changed-cc67af0c-51e8-43bf-885f-302f61325c66. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7dd212ba-6815-460f-a10a-86173493fcc1 req-3c6bbe08-2af2-49c6-834f-21a6c8e6026b service nova] Acquiring lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7dd212ba-6815-460f-a10a-86173493fcc1 req-3c6bbe08-2af2-49c6-834f-21a6c8e6026b service nova] Acquired lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-7dd212ba-6815-460f-a10a-86173493fcc1 req-3c6bbe08-2af2-49c6-834f-21a6c8e6026b service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Refreshing network info cache for port cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lazy-loading 'flavor' on Instance uuid c94b60f1-bfc1-488a-9c12-255a15a29002 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:51 user nova-compute[72803]: INFO nova.compute.manager [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Attaching volume 6f9e737b-e12f-41f4-8983-8c6b83d51518 to /dev/vdb
Aug 15 06:57:51 user nova-compute[72803]: DEBUG nova.network.neutron [req-a910cc59-7736-403e-a066-eeb3fd104f9d req-2246a1f4-eea4-4dd8-bbdf-0a2eb6164748 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updated VIF entry in instance network info cache for port d9a98be4-bb66-4f3f-a354-5a1767c3c891. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG nova.network.neutron [req-a910cc59-7736-403e-a066-eeb3fd104f9d req-2246a1f4-eea4-4dd8-bbdf-0a2eb6164748 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updating instance_info_cache with network_info: [{"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG os_brick.utils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a910cc59-7736-403e-a066-eeb3fd104f9d req-2246a1f4-eea4-4dd8-bbdf-0a2eb6164748 service nova] Releasing lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[873fc39f-b2bc-430f-acbf-c100d6e45c88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e95f0-c249-4273-94d4-c5e4b44bc3b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d6e445-7f15-4c53-882a-ecd6e40cb495]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[33831258-306d-44cc-9e87-ab4397d05523]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:51 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:57:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a55b8b-8a64-4c9b-92f5-ec8f974574f6]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG os_brick.utils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Updating existing volume attachment record: c5258cd3-48b0-46ed-97a0-7e23f9e62812 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23362326564663764', 'path': '/dev/sdh'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362326564663764', 'path': '/dev/sdh'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG nova.objects.instance [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid ff252c72-caf0-4c90-b078-6aab5a0b1fab {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:57:51 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:57:51 user nova-compute[72803]:   <source dev="/dev/sdh"/>
Aug 15 06:57:51 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:57:51 user nova-compute[72803]:   <serial>7339a01d-8222-4c04-ba6e-4634c6bfbdca</serial>
Aug 15 06:57:51 user nova-compute[72803]: </disk>
Aug 15 06:57:51 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:57:52 user nova-compute[72803]: DEBUG nova.network.neutron [req-7dd212ba-6815-460f-a10a-86173493fcc1 req-3c6bbe08-2af2-49c6-834f-21a6c8e6026b service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Updated VIF entry in instance network info cache for port cc67af0c-51e8-43bf-885f-302f61325c66. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:52 user nova-compute[72803]: DEBUG nova.network.neutron [req-7dd212ba-6815-460f-a10a-86173493fcc1 req-3c6bbe08-2af2-49c6-834f-21a6c8e6026b service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Updating instance_info_cache with network_info: [{"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7dd212ba-6815-460f-a10a-86173493fcc1 req-3c6bbe08-2af2-49c6-834f-21a6c8e6026b service nova] Releasing lock "refresh_cache-c94b60f1-bfc1-488a-9c12-255a15a29002" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:57:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:57:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No VIF found with MAC fa:16:3e:3d:7a:93, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:57:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6997e1bf-de4e-404b-9ee0-9e2a0156578d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.314s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:53 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082658.8199468, 454ea345-aaa5-423b-add3-20a933978eec => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:57:53 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] VM Stopped (Lifecycle Event)
Aug 15 06:57:53 user nova-compute[72803]: DEBUG nova.compute.manager [None req-55239199-9184-42d2-98e5-734e6856c11b None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:57:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-c063bd6e-430d-4232-83fd-b9d273305491 req-e6b14372-311b-486f-80a0-1b30b28a1ee9 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received event network-changed-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-c063bd6e-430d-4232-83fd-b9d273305491 req-e6b14372-311b-486f-80a0-1b30b28a1ee9 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Refreshing instance network info cache due to event network-changed-1aea96c7-e182-4d42-87a3-d88c60d92608. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c063bd6e-430d-4232-83fd-b9d273305491 req-e6b14372-311b-486f-80a0-1b30b28a1ee9 service nova] Acquiring lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c063bd6e-430d-4232-83fd-b9d273305491 req-e6b14372-311b-486f-80a0-1b30b28a1ee9 service nova] Acquired lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:54 user nova-compute[72803]: DEBUG nova.network.neutron [req-c063bd6e-430d-4232-83fd-b9d273305491 req-e6b14372-311b-486f-80a0-1b30b28a1ee9 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Refreshing network info cache for port 1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG nova.network.neutron [req-c063bd6e-430d-4232-83fd-b9d273305491 req-e6b14372-311b-486f-80a0-1b30b28a1ee9 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Updated VIF entry in instance network info cache for port 1aea96c7-e182-4d42-87a3-d88c60d92608. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG nova.network.neutron [req-c063bd6e-430d-4232-83fd-b9d273305491 req-e6b14372-311b-486f-80a0-1b30b28a1ee9 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Updating instance_info_cache with network_info: [{"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c063bd6e-430d-4232-83fd-b9d273305491 req-e6b14372-311b-486f-80a0-1b30b28a1ee9 service nova] Releasing lock "refresh_cache-2daeef6a-2d82-4d18-94ec-11fce8ed7479" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'flavor' on Instance uuid 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:55 user nova-compute[72803]: INFO nova.compute.manager [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Attaching volume 9cda6892-d024-4b8a-b05f-75066cd85472 to /dev/vdb
Aug 15 06:57:55 user nova-compute[72803]: DEBUG os_brick.utils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:57:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9faa79-218a-4fa3-ab50-ceeb8e0ae5bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bd2967-f978-488d-82b9-10ce9bb2c1b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4747400b-5774-4aca-8450-bf1b316add48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3e354f-6e0a-4aea-8426-2de8f7935812]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:57:56 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc07bb6-b6f1-47d8-8585-c2331c0158ff]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG os_brick.utils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updating existing volume attachment record: f169b676-a903-479a-8380-e1241127cf2a {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:57:56 user nova-compute[72803]: INFO nova.compute.claims [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Claim successful on node user
Aug 15 06:57:56 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:57:56 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:57:56 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:57:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:57:57 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Creating image(s)
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "/opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "/opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "/opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG nova.policy [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50b2d95238654df88548e1549fa73210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3743fde3d93f4fed84b52926dadc07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.220s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk 1073741824" returned: 0 in 0.105s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.229s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:57:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Successfully created port: 3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Cannot resize image /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'migration_context' on Instance uuid d543c8cd-83cf-4474-a35d-f3c7b7f08093 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Ensure instance console log exists: /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Successfully updated port: 3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquired lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-e6050feb-cdb4-45bd-9ef6-dedb57053281 req-50afeb88-f9d8-40d4-98fc-8dd2661a648d service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received event network-changed-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-e6050feb-cdb4-45bd-9ef6-dedb57053281 req-50afeb88-f9d8-40d4-98fc-8dd2661a648d service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Refreshing instance network info cache due to event network-changed-3e51a234-0440-4398-84ac-ae703e9924d9. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e6050feb-cdb4-45bd-9ef6-dedb57053281 req-50afeb88-f9d8-40d4-98fc-8dd2661a648d service nova] Acquiring lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Updating instance_info_cache with network_info: [{"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Releasing lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Instance network_info: |[{"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e6050feb-cdb4-45bd-9ef6-dedb57053281 req-50afeb88-f9d8-40d4-98fc-8dd2661a648d service nova] Acquired lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-e6050feb-cdb4-45bd-9ef6-dedb57053281 req-50afeb88-f9d8-40d4-98fc-8dd2661a648d service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Refreshing network info cache for port 3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Start _get_guest_xml network_info=[{"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:57:59 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:59 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-251581683',display_name='tempest-AttachVolumeNegativeTest-server-251581683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-251581683',id=13,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOjp74boQAcPOzhfM5kBFlFgWgLHTvZ74B587wtfgYO/5CR09yT+Py9I3o0pqkTL/QHn/SbefwrNgF1kkVtNXYFMJLEqTztZmwGspr7D7FFCr0SzPo7mgGkMbYrJouGyQ==',key_name='tempest-keypair-911851804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-wcw2zcyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=d543c8cd-83cf-4474-a35d-f3c7b7f08093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:86:ed,bridge_name='br-int',has_traffic_filtering=True,id=3e51a234-0440-4398-84ac-ae703e9924d9,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e51a234-04') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'pci_devices' on Instance uuid d543c8cd-83cf-4474-a35d-f3c7b7f08093 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:57:59 user nova-compute[72803]:   <uuid>d543c8cd-83cf-4474-a35d-f3c7b7f08093</uuid>
Aug 15 06:57:59 user nova-compute[72803]:   <name>instance-0000000d</name>
Aug 15 06:57:59 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:57:59 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:57:59 user nova-compute[72803]:   <metadata>
Aug 15 06:57:59 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:57:59 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:57:59 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeNegativeTest-server-251581683</nova:name>
Aug 15 06:57:59 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:57:59</nova:creationTime>
Aug 15 06:57:59 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:57:59 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:57:59 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:57:59 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:57:59 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:57:59 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:57:59 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:57:59 user nova-compute[72803]:       <nova:owner>
Aug 15 06:57:59 user nova-compute[72803]:         <nova:user uuid="50b2d95238654df88548e1549fa73210">tempest-AttachVolumeNegativeTest-37766204-project-member</nova:user>
Aug 15 06:57:59 user nova-compute[72803]:         <nova:project uuid="3743fde3d93f4fed84b52926dadc07f7">tempest-AttachVolumeNegativeTest-37766204</nova:project>
Aug 15 06:57:59 user nova-compute[72803]:       </nova:owner>
Aug 15 06:57:59 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:57:59 user nova-compute[72803]:       <nova:ports>
Aug 15 06:57:59 user nova-compute[72803]:         <nova:port uuid="3e51a234-0440-4398-84ac-ae703e9924d9">
Aug 15 06:57:59 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 06:57:59 user nova-compute[72803]:         </nova:port>
Aug 15 06:57:59 user nova-compute[72803]:       </nova:ports>
Aug 15 06:57:59 user nova-compute[72803]:     </nova:instance>
Aug 15 06:57:59 user nova-compute[72803]:   </metadata>
Aug 15 06:57:59 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:57:59 user nova-compute[72803]:     <system>
Aug 15 06:57:59 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:57:59 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:57:59 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:57:59 user nova-compute[72803]:       <entry name="serial">d543c8cd-83cf-4474-a35d-f3c7b7f08093</entry>
Aug 15 06:57:59 user nova-compute[72803]:       <entry name="uuid">d543c8cd-83cf-4474-a35d-f3c7b7f08093</entry>
Aug 15 06:57:59 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:57:59 user nova-compute[72803]:     </system>
Aug 15 06:57:59 user nova-compute[72803]:   </sysinfo>
Aug 15 06:57:59 user nova-compute[72803]:   <os>
Aug 15 06:57:59 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:57:59 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:57:59 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:57:59 user nova-compute[72803]:   </os>
Aug 15 06:57:59 user nova-compute[72803]:   <features>
Aug 15 06:57:59 user nova-compute[72803]:     <acpi/>
Aug 15 06:57:59 user nova-compute[72803]:     <apic/>
Aug 15 06:57:59 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:57:59 user nova-compute[72803]:   </features>
Aug 15 06:57:59 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:57:59 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:57:59 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:57:59 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:57:59 user nova-compute[72803]:   </clock>
Aug 15 06:57:59 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:57:59 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:57:59 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:57:59 user nova-compute[72803]:   </cpu>
Aug 15 06:57:59 user nova-compute[72803]:   <devices>
Aug 15 06:57:59 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:57:59 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:57:59 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk"/>
Aug 15 06:57:59 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:57:59 user nova-compute[72803]:     </disk>
Aug 15 06:57:59 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:57:59 user nova-compute[72803]:       <mac address="fa:16:3e:f2:86:ed"/>
Aug 15 06:57:59 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:59 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:57:59 user nova-compute[72803]:       <target dev="tap3e51a234-04"/>
Aug 15 06:57:59 user nova-compute[72803]:     </interface>
Aug 15 06:57:59 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:57:59 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/console.log" append="off"/>
Aug 15 06:57:59 user nova-compute[72803]:     </serial>
Aug 15 06:57:59 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:57:59 user nova-compute[72803]:     <video>
Aug 15 06:57:59 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:57:59 user nova-compute[72803]:     </video>
Aug 15 06:57:59 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:57:59 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:57:59 user nova-compute[72803]:     </rng>
Aug 15 06:57:59 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:57:59 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:57:59 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:57:59 user nova-compute[72803]:     </memballoon>
Aug 15 06:57:59 user nova-compute[72803]:   </devices>
Aug 15 06:57:59 user nova-compute[72803]: </domain>
Aug 15 06:57:59 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-251581683',display_name='tempest-AttachVolumeNegativeTest-server-251581683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-251581683',id=13,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOjp74boQAcPOzhfM5kBFlFgWgLHTvZ74B587wtfgYO/5CR09yT+Py9I3o0pqkTL/QHn/SbefwrNgF1kkVtNXYFMJLEqTztZmwGspr7D7FFCr0SzPo7mgGkMbYrJouGyQ==',key_name='tempest-keypair-911851804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-wcw2zcyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=d543c8cd-83cf-4474-a35d-f3c7b7f08093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:86:ed,bridge_name='br-int',has_traffic_filtering=True,id=3e51a234-0440-4398-84ac-ae703e9924d9,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e51a234-04') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG os_vif [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:86:ed,bridge_name='br-int',has_traffic_filtering=True,id=3e51a234-0440-4398-84ac-ae703e9924d9,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e51a234-04') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e51a234-04, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e51a234-04, col_values=(('external_ids', {'iface-id': '3e51a234-0440-4398-84ac-ae703e9924d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:86:ed', 'vm-uuid': 'd543c8cd-83cf-4474-a35d-f3c7b7f08093'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:57:59 user nova-compute[72803]: INFO os_vif [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:86:ed,bridge_name='br-int',has_traffic_filtering=True,id=3e51a234-0440-4398-84ac-ae703e9924d9,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e51a234-04')
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No VIF found with MAC fa:16:3e:f2:86:ed, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lazy-loading 'flavor' on Instance uuid 2daeef6a-2d82-4d18-94ec-11fce8ed7479 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:57:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-e6050feb-cdb4-45bd-9ef6-dedb57053281 req-50afeb88-f9d8-40d4-98fc-8dd2661a648d service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Updated VIF entry in instance network info cache for port 3e51a234-0440-4398-84ac-ae703e9924d9. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-e6050feb-cdb4-45bd-9ef6-dedb57053281 req-50afeb88-f9d8-40d4-98fc-8dd2661a648d service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Updating instance_info_cache with network_info: [{"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e6050feb-cdb4-45bd-9ef6-dedb57053281 req-50afeb88-f9d8-40d4-98fc-8dd2661a648d service nova] Releasing lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-aa553d80-201c-49f6-8d03-111dc2f741ff req-083dea6b-fe18-42a4-870b-51fd5d5696e9 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-changed-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-aa553d80-201c-49f6-8d03-111dc2f741ff req-083dea6b-fe18-42a4-870b-51fd5d5696e9 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Refreshing instance network info cache due to event network-changed-416da12a-d56b-4d09-bc66-5b4a195a07bd. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aa553d80-201c-49f6-8d03-111dc2f741ff req-083dea6b-fe18-42a4-870b-51fd5d5696e9 service nova] Acquiring lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aa553d80-201c-49f6-8d03-111dc2f741ff req-083dea6b-fe18-42a4-870b-51fd5d5696e9 service nova] Acquired lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-aa553d80-201c-49f6-8d03-111dc2f741ff req-083dea6b-fe18-42a4-870b-51fd5d5696e9 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Refreshing network info cache for port 416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:00 user nova-compute[72803]: INFO nova.compute.manager [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Attaching volume 648eb379-a3dc-40b1-97c6-6629adad54bf to /dev/sdc
Aug 15 06:58:00 user nova-compute[72803]: DEBUG os_brick.utils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a59188c-0e24-41f3-ba6e-9978a97f35a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a071b8a-6676-4afa-a3b3-b9d811735490]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[77936634-9220-4cc7-99de-d54402d3364e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[897f1e06-f6bc-498c-a484-1c8b27aa191a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:00 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc17621f-899f-4653-938c-471b7482c8ec]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG os_brick.utils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Updating existing volume attachment record: 205cb97e-e8a1-4b9f-94df-256e24061a56 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "interface-f015c02e-e530-4ec9-9fac-6efad4535956-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "interface-f015c02e-e530-4ec9-9fac-6efad4535956-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lazy-loading 'flavor' on Instance uuid f015c02e-e530-4ec9-9fac-6efad4535956 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-aa553d80-201c-49f6-8d03-111dc2f741ff req-083dea6b-fe18-42a4-870b-51fd5d5696e9 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updated VIF entry in instance network info cache for port 416da12a-d56b-4d09-bc66-5b4a195a07bd. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-aa553d80-201c-49f6-8d03-111dc2f741ff req-083dea6b-fe18-42a4-870b-51fd5d5696e9 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updating instance_info_cache with network_info: [{"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aa553d80-201c-49f6-8d03-111dc2f741ff req-083dea6b-fe18-42a4-870b-51fd5d5696e9 service nova] Releasing lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lazy-loading 'pci_requests' on Instance uuid f015c02e-e530-4ec9-9fac-6efad4535956 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:58:00 user nova-compute[72803]: DEBUG nova.policy [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f8e6404c768452486b45a430e7946bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9b2d99c28f48ef8d27cd0ff70877ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-624a7e65-0908-4b37-85d7-684d8c52fe00 req-27c647a3-71ad-496e-822b-f363f7a04e67 service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received event network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-624a7e65-0908-4b37-85d7-684d8c52fe00 req-27c647a3-71ad-496e-822b-f363f7a04e67 service nova] Acquiring lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-624a7e65-0908-4b37-85d7-684d8c52fe00 req-27c647a3-71ad-496e-822b-f363f7a04e67 service nova] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-624a7e65-0908-4b37-85d7-684d8c52fe00 req-27c647a3-71ad-496e-822b-f363f7a04e67 service nova] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-624a7e65-0908-4b37-85d7-684d8c52fe00 req-27c647a3-71ad-496e-822b-f363f7a04e67 service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] No waiting events found dispatching network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:01 user nova-compute[72803]: WARNING nova.compute.manager [req-624a7e65-0908-4b37-85d7-684d8c52fe00 req-27c647a3-71ad-496e-822b-f363f7a04e67 service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received unexpected event network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 for instance with vm_state building and task_state spawning.
Aug 15 06:58:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:01 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Successfully created port: 9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:58:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Successfully updated port: 9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:58:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquired lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:58:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-abf81bcc-61d3-4cba-b487-d72a79780246 req-676c5afe-4378-4001-a28f-1065c0b7e562 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-changed-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-abf81bcc-61d3-4cba-b487-d72a79780246 req-676c5afe-4378-4001-a28f-1065c0b7e562 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Refreshing instance network info cache due to event network-changed-9aba22c3-8980-4950-9867-67a6d68dd566. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:58:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-abf81bcc-61d3-4cba-b487-d72a79780246 req-676c5afe-4378-4001-a28f-1065c0b7e562 service nova] Acquiring lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082683.3539734, d543c8cd-83cf-4474-a35d-f3c7b7f08093 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:58:03 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] VM Resumed (Lifecycle Event)
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:58:03 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Instance spawned successfully.
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:03 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082683.3563254, d543c8cd-83cf-4474-a35d-f3c7b7f08093 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:58:03 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] VM Started (Lifecycle Event)
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-aafe9f7a-f4b8-4b92-aec8-1c165f3ab89a req-963a8abf-5879-4763-b5e8-2c2b0901255c service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received event network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aafe9f7a-f4b8-4b92-aec8-1c165f3ab89a req-963a8abf-5879-4763-b5e8-2c2b0901255c service nova] Acquiring lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aafe9f7a-f4b8-4b92-aec8-1c165f3ab89a req-963a8abf-5879-4763-b5e8-2c2b0901255c service nova] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aafe9f7a-f4b8-4b92-aec8-1c165f3ab89a req-963a8abf-5879-4763-b5e8-2c2b0901255c service nova] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-aafe9f7a-f4b8-4b92-aec8-1c165f3ab89a req-963a8abf-5879-4763-b5e8-2c2b0901255c service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] No waiting events found dispatching network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:03 user nova-compute[72803]: WARNING nova.compute.manager [req-aafe9f7a-f4b8-4b92-aec8-1c165f3ab89a req-963a8abf-5879-4763-b5e8-2c2b0901255c service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received unexpected event network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 for instance with vm_state building and task_state spawning.
Aug 15 06:58:03 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updating instance_info_cache with network_info: [{"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aba22c3-8980-4950-9867-67a6d68dd566", "address": "fa:16:3e:42:cc:3d", "network": {"id": "40f090e4-fac8-47c1-a074-ea9325c05f2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307198364", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aba22c3-89", "ovs_interfaceid": "9aba22c3-8980-4950-9867-67a6d68dd566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:03 user nova-compute[72803]: INFO nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Releasing lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-abf81bcc-61d3-4cba-b487-d72a79780246 req-676c5afe-4378-4001-a28f-1065c0b7e562 service nova] Acquired lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.network.neutron [req-abf81bcc-61d3-4cba-b487-d72a79780246 req-676c5afe-4378-4001-a28f-1065c0b7e562 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Refreshing network info cache for port 9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-98050795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-98050795',id=8,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPKY+eZFkSlg5JqDkuJvKg+ZJP8v4pk8imXoFKXn2eMzTXRBaJk246PztdgOvZODS5yxBQVbWaWO8rygXkwX90itcuhyLQsmgtG7Ne0MJ4N4m9xqLZzVmYrRsewekfXLw==',key_name='tempest-keypair-1472456205',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1f9b2d99c28f48ef8d27cd0ff70877ce',ramdisk_id='',reservation_id='r-grgwpcsd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-954480488',owner_user_name='tempest-TaggedAttachmentsTest-954480488-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8e6404c768452486b45a430e7946bb',uuid=f015c02e-e530-4ec9-9fac-6efad4535956,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aba22c3-8980-4950-9867-67a6d68dd566", "address": "fa:16:3e:42:cc:3d", "network": {"id": "40f090e4-fac8-47c1-a074-ea9325c05f2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307198364", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aba22c3-89", "ovs_interfaceid": "9aba22c3-8980-4950-9867-67a6d68dd566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converting VIF {"id": "9aba22c3-8980-4950-9867-67a6d68dd566", "address": "fa:16:3e:42:cc:3d", "network": {"id": "40f090e4-fac8-47c1-a074-ea9325c05f2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307198364", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aba22c3-89", "ovs_interfaceid": "9aba22c3-8980-4950-9867-67a6d68dd566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:cc:3d,bridge_name='br-int',has_traffic_filtering=True,id=9aba22c3-8980-4950-9867-67a6d68dd566,network=Network(40f090e4-fac8-47c1-a074-ea9325c05f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aba22c3-89') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG os_vif [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:cc:3d,bridge_name='br-int',has_traffic_filtering=True,id=9aba22c3-8980-4950-9867-67a6d68dd566,network=Network(40f090e4-fac8-47c1-a074-ea9325c05f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aba22c3-89') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aba22c3-89, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9aba22c3-89, col_values=(('external_ids', {'iface-id': '9aba22c3-8980-4950-9867-67a6d68dd566', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:cc:3d', 'vm-uuid': 'f015c02e-e530-4ec9-9fac-6efad4535956'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:03 user nova-compute[72803]: INFO os_vif [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:cc:3d,bridge_name='br-int',has_traffic_filtering=True,id=9aba22c3-8980-4950-9867-67a6d68dd566,network=Network(40f090e4-fac8-47c1-a074-ea9325c05f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aba22c3-89')
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-98050795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-98050795',id=8,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPKY+eZFkSlg5JqDkuJvKg+ZJP8v4pk8imXoFKXn2eMzTXRBaJk246PztdgOvZODS5yxBQVbWaWO8rygXkwX90itcuhyLQsmgtG7Ne0MJ4N4m9xqLZzVmYrRsewekfXLw==',key_name='tempest-keypair-1472456205',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1f9b2d99c28f48ef8d27cd0ff70877ce',ramdisk_id='',reservation_id='r-grgwpcsd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-954480488',owner_user_name='tempest-TaggedAttachmentsTest-954480488-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8e6404c768452486b45a430e7946bb',uuid=f015c02e-e530-4ec9-9fac-6efad4535956,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aba22c3-8980-4950-9867-67a6d68dd566", "address": "fa:16:3e:42:cc:3d", "network": {"id": "40f090e4-fac8-47c1-a074-ea9325c05f2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307198364", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aba22c3-89", "ovs_interfaceid": "9aba22c3-8980-4950-9867-67a6d68dd566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converting VIF {"id": "9aba22c3-8980-4950-9867-67a6d68dd566", "address": "fa:16:3e:42:cc:3d", "network": {"id": "40f090e4-fac8-47c1-a074-ea9325c05f2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307198364", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aba22c3-89", "ovs_interfaceid": "9aba22c3-8980-4950-9867-67a6d68dd566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:cc:3d,bridge_name='br-int',has_traffic_filtering=True,id=9aba22c3-8980-4950-9867-67a6d68dd566,network=Network(40f090e4-fac8-47c1-a074-ea9325c05f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aba22c3-89') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] attach device xml: <interface type="ethernet">
Aug 15 06:58:03 user nova-compute[72803]:   <mac address="fa:16:3e:42:cc:3d"/>
Aug 15 06:58:03 user nova-compute[72803]:   <model type="virtio"/>
Aug 15 06:58:03 user nova-compute[72803]:   <mtu size="1442"/>
Aug 15 06:58:03 user nova-compute[72803]:   <target dev="tap9aba22c3-89"/>
Aug 15 06:58:03 user nova-compute[72803]: </interface>
Aug 15 06:58:03 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:03 user nova-compute[72803]: INFO nova.compute.manager [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Took 7.32 seconds to build instance.
Aug 15 06:58:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8ebfbe97-74dc-43d1-9c13-73bb482a5a56 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.447s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-47ac6141-8f8e-4c6d-9554-914808058bfa req-49a22208-289a-401f-b76f-a7a2b89881fe service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received event network-changed-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-47ac6141-8f8e-4c6d-9554-914808058bfa req-49a22208-289a-401f-b76f-a7a2b89881fe service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Refreshing instance network info cache due to event network-changed-360678a7-0b9e-453e-9a29-15e9b88ac0c4. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-47ac6141-8f8e-4c6d-9554-914808058bfa req-49a22208-289a-401f-b76f-a7a2b89881fe service nova] Acquiring lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-47ac6141-8f8e-4c6d-9554-914808058bfa req-49a22208-289a-401f-b76f-a7a2b89881fe service nova] Acquired lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-47ac6141-8f8e-4c6d-9554-914808058bfa req-49a22208-289a-401f-b76f-a7a2b89881fe service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Refreshing network info cache for port 360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHsvIuOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:04 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:04 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:04 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9119721-fba0-4c93-9950-757772fa47c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:58:04 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] No BDM found with device name hda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] No VIF found with MAC fa:16:3e:42:30:af, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c32d44-24b1-49c6-afee-adcf3c52c97a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518] added
Aug 15 06:58:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:58:04 user nova-compute[72803]:   <nova:package version="0.0.0"/>
Aug 15 06:58:04 user nova-compute[72803]:   <nova:name>tempest-device-tagging-server-98050795</nova:name>
Aug 15 06:58:04 user nova-compute[72803]:   <nova:creationTime>2023-08-15 06:58:04</nova:creationTime>
Aug 15 06:58:04 user nova-compute[72803]:   <nova:flavor name="m1.tiny">
Aug 15 06:58:04 user nova-compute[72803]:     <nova:memory>512</nova:memory>
Aug 15 06:58:04 user nova-compute[72803]:     <nova:disk>1</nova:disk>
Aug 15 06:58:04 user nova-compute[72803]:     <nova:swap>0</nova:swap>
Aug 15 06:58:04 user nova-compute[72803]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:58:04 user nova-compute[72803]:     <nova:vcpus>1</nova:vcpus>
Aug 15 06:58:04 user nova-compute[72803]:   </nova:flavor>
Aug 15 06:58:04 user nova-compute[72803]:   <nova:owner>
Aug 15 06:58:04 user nova-compute[72803]:     <nova:user uuid="9f8e6404c768452486b45a430e7946bb">tempest-TaggedAttachmentsTest-954480488-project-member</nova:user>
Aug 15 06:58:04 user nova-compute[72803]:     <nova:project uuid="1f9b2d99c28f48ef8d27cd0ff70877ce">tempest-TaggedAttachmentsTest-954480488</nova:project>
Aug 15 06:58:04 user nova-compute[72803]:   </nova:owner>
Aug 15 06:58:04 user nova-compute[72803]:   <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:58:04 user nova-compute[72803]:   <nova:ports>
Aug 15 06:58:04 user nova-compute[72803]:     <nova:port uuid="416da12a-d56b-4d09-bc66-5b4a195a07bd">
Aug 15 06:58:04 user nova-compute[72803]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 06:58:04 user nova-compute[72803]:     </nova:port>
Aug 15 06:58:04 user nova-compute[72803]:     <nova:port uuid="9aba22c3-8980-4950-9867-67a6d68dd566">
Aug 15 06:58:04 user nova-compute[72803]:       <nova:ip type="fixed" address="10.10.10.152" ipVersion="4"/>
Aug 15 06:58:04 user nova-compute[72803]:     </nova:port>
Aug 15 06:58:04 user nova-compute[72803]:   </nova:ports>
Aug 15 06:58:04 user nova-compute[72803]: </nova:instance>
Aug 15 06:58:04 user nova-compute[72803]:  {{(pid=72803) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaccf4f-6d20-404f-a244-1cc78dc3b09c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cf341fdf-d418-485d-9df9-265acee0c34a tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "interface-f015c02e-e530-4ec9-9fac-6efad4535956-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.612s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[89311799-c1a6-427b-80cc-7c0158444323]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHsvIuOJ {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHsvIuOJ" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0271dcca-9807-4fc0-bb39-66a8a3333a73]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SHsvIuOJ'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac7e1a-e926-4ceb-82d3-d4468d950959]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-abf81bcc-61d3-4cba-b487-d72a79780246 req-676c5afe-4378-4001-a28f-1065c0b7e562 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updated VIF entry in instance network info cache for port 9aba22c3-8980-4950-9867-67a6d68dd566. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-abf81bcc-61d3-4cba-b487-d72a79780246 req-676c5afe-4378-4001-a28f-1065c0b7e562 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updating instance_info_cache with network_info: [{"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9aba22c3-8980-4950-9867-67a6d68dd566", "address": "fa:16:3e:42:cc:3d", "network": {"id": "40f090e4-fac8-47c1-a074-ea9325c05f2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307198364", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aba22c3-89", "ovs_interfaceid": "9aba22c3-8980-4950-9867-67a6d68dd566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[22642aec-8462-44cd-a4ca-9e8ba791b8db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-abf81bcc-61d3-4cba-b487-d72a79780246 req-676c5afe-4378-4001-a28f-1065c0b7e562 service nova] Releasing lock "refresh_cache-f015c02e-e530-4ec9-9fac-6efad4535956" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lazy-loading 'flavor' on Instance uuid 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e109053b-496c-4f6b-9f31-86c0e6cacaf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518, portal: 172.16.0.220,3260]
Aug 15 06:58:04 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f007db6-e410-423f-9dcd-cf5a7053445d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce881097-adac-42c5-a03b-6cc618d05dd5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:04 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.478s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.038s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db8ab74-3c68-4ce8-97a3-c1a8058e75a4]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHsvIuOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:04 user nova-compute[72803]: INFO nova.compute.manager [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Attaching volume 547af602-6fdf-4a6b-b82e-af811864f6b5 to /dev/vdb
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.objects.instance [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lazy-loading 'flavor' on Instance uuid f015c02e-e530-4ec9-9fac-6efad4535956 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-47ac6141-8f8e-4c6d-9554-914808058bfa req-49a22208-289a-401f-b76f-a7a2b89881fe service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Updated VIF entry in instance network info cache for port 360678a7-0b9e-453e-9a29-15e9b88ac0c4. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-47ac6141-8f8e-4c6d-9554-914808058bfa req-49a22208-289a-401f-b76f-a7a2b89881fe service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Updating instance_info_cache with network_info: [{"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-47ac6141-8f8e-4c6d-9554-914808058bfa req-49a22208-289a-401f-b76f-a7a2b89881fe service nova] Releasing lock "refresh_cache-0cb66e88-04aa-47cb-b403-16e16704a9f9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.utils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf39e6b-ba11-4031-856e-a48ac7217278]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c210594-20ea-4f48-aafe-0baefb22c9f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5335c35-63b2-4af8-bfe2-e88ddbbd46f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088b670-ce85-4543-ae02-df2469f49b66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:04 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:58:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc16f778-0257-4e0c-b0f3-123b7f9f8d16]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG os_brick.utils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:04 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Updating existing volume attachment record: 21c64ed9-1dfe-4cd0-864e-7996c309d7df {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:05 user nova-compute[72803]: INFO nova.compute.manager [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Attaching volume dcb10b8f-e260-4207-a24b-b681c2619b88 to /dev/vdb
Aug 15 06:58:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] No waiting events found dispatching network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:05 user nova-compute[72803]: WARNING nova.compute.manager [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received unexpected event network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 for instance with vm_state active and task_state None.
Aug 15 06:58:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] No waiting events found dispatching network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:05 user nova-compute[72803]: WARNING nova.compute.manager [req-a4eaea1e-5a42-48c6-87dc-3952698f1ab7 req-07d81798-a3e2-4fac-a9d5-aef9819f7667 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received unexpected event network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 for instance with vm_state active and task_state None.
Aug 15 06:58:05 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.549s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] <== connect_volume: return (1551ms) {'type': 'block', 'scsi_wwn': '23933326263663738', 'path': '/dev/sdi'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933326263663738', 'path': '/dev/sdi'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lazy-loading 'flavor' on Instance uuid c94b60f1-bfc1-488a-9c12-255a15a29002 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 06:58:05 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:05 user nova-compute[72803]:   <source dev="/dev/sdi"/>
Aug 15 06:58:05 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:05 user nova-compute[72803]:   <serial>6f9e737b-e12f-41f4-8983-8c6b83d51518</serial>
Aug 15 06:58:05 user nova-compute[72803]: </disk>
Aug 15 06:58:05 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:58:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] No VIF found with MAC fa:16:3e:ec:68:65, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztbJavXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:07 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:07 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:07 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b32f61-2ab2-4475-8d9e-ed24a56d2459]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:58:07 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee22861-625a-4c31-8cdd-1298de3bf844]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472] added
Aug 15 06:58:07 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef10c09b-f935-43e2-8542-0b615fb816f0]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.066s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[497bdf3a-6418-4925-bb77-1f073aac350d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztbJavXf {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztbJavXf" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a76c42-b0c0-4094-9376-d58b42cc78cd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztbJavXf'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b56162-0729-45cc-b03f-ad05227a03b4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbabea42-a4f8-4610-8fea-e621d7b6e447]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[41945905-480b-4531-8a40-b8e1653788ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472, portal: 172.16.0.220,3260]
Aug 15 06:58:08 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4de6255-4d63-4bd4-8d90-33ed6b4aa8bf]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb50132-b5c9-4118-9006-8f4f41e163c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:08 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc392ed-3ab8-4ea5-a399-8a1357ba6e27]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e1bda249-71bc-4a36-b585-01dbd5eccc1f tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.795s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.utils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e8657-3538-4c61-96bc-37d2bd63fc07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[839f6fbf-14e2-4c8e-8eb5-168a07b1a8a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c844f56-2001-447d-91ba-f52b4a5e372f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ce4c1-1409-4027-8661-88b7a556abda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:08 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:58:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b9a50-f18a-43ff-aca6-6fb660a3f937]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG os_brick.utils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updating existing volume attachment record: dc544093-a82d-4174-b6cd-bbc7fb872a79 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztbJavXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '23335383633356435', 'path': '/dev/sdj'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335383633356435', 'path': '/dev/sdj'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'flavor' on Instance uuid 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:58:09 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:09 user nova-compute[72803]:   <source dev="/dev/sdj"/>
Aug 15 06:58:09 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:09 user nova-compute[72803]:   <serial>9cda6892-d024-4b8a-b05f-75066cd85472</serial>
Aug 15 06:58:09 user nova-compute[72803]: </disk>
Aug 15 06:58:09 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] No VIF found with MAC fa:16:3e:b7:af:27, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVaxXBYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:12 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:12 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:12 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b1d06-a20e-4c74-954c-4c28b7e4db3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:58:12 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e63b18-7ac6-4357-9566-4b527deadb87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf] added
Aug 15 06:58:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc7b9b6-704c-4224-89a4-8b899fb48fca]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff50c16e-5510-448d-8a73-5601138907e3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVaxXBYO {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVaxXBYO" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5250d727-dca1-49f2-be0e-fe00a341fb18]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CVaxXBYO'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c105d6-332d-425e-8b85-8b5660217a5f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68632b1-da5e-493b-aacc-1e06a8b7dce0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3b64e44f-7a19-4c5d-8045-b436e155bd5c tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.508s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28cf0c1-dd84-4bba-a72e-30b9c8ee3d03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf, portal: 172.16.0.220,3260]
Aug 15 06:58:12 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2773a8-ef95-4485-ac77-3621b2edbee2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e16931f-5f6a-428e-b3cf-94a04e317192]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:12 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adb960f-a1af-467b-875f-ba08631b4ab6]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVaxXBYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a0ab23af-8c86-43ea-aa27-4363b88ea298 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] volume_snapshot_create: create_info: {'snapshot_id': '90c87aa7-0b8a-438b-b1cb-c5bdd2ada7c2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72803) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a0ab23af-8c86-43ea-aa27-4363b88ea298 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] snap xml: <domainsnapshot>
Aug 15 06:58:12 user nova-compute[72803]:   <disks>
Aug 15 06:58:12 user nova-compute[72803]:     <disk name="/dev/sdi" snapshot="external" type="file">
Aug 15 06:58:12 user nova-compute[72803]:       <source file="/dev/new_file"/>
Aug 15 06:58:12 user nova-compute[72803]:     </disk>
Aug 15 06:58:12 user nova-compute[72803]:     <disk name="vda" snapshot="no"/>
Aug 15 06:58:12 user nova-compute[72803]:   </disks>
Aug 15 06:58:12 user nova-compute[72803]: </domainsnapshot>
Aug 15 06:58:12 user nova-compute[72803]:  {{(pid=72803) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 06:58:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a0ab23af-8c86-43ea-aa27-4363b88ea298 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lazy-loading 'system_metadata' on Instance uuid c94b60f1-bfc1-488a-9c12-255a15a29002 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:12 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a0ab23af-8c86-43ea-aa27-4363b88ea298 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [None req-a0ab23af-8c86-43ea-aa27-4363b88ea298 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     rv = execute(f, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     six.reraise(c, e, tb)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     raise value
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     rv = meth(*args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [None req-a0ab23af-8c86-43ea-aa27-4363b88ea298 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     self._volume_snapshot_create(context, instance, guest,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     rv = execute(f, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     six.reraise(c, e, tb)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     raise value
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     rv = meth(*args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] 
Aug 15 06:58:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-92d07c6f-952c-448b-b941-c78aff8efb42 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] volume_snapshot_delete: delete_info: {'volume_id': '6f9e737b-e12f-41f4-8983-8c6b83d51518'} {{(pid=72803) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [None req-92d07c6f-952c-448b-b941-c78aff8efb42 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002]     if delete_info['type'] != 'qcow2':
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] KeyError: 'type'
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [None req-a0ab23af-8c86-43ea-aa27-4363b88ea298 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 90c87aa7-0b8a-438b-b1cb-c5bdd2ada7c2 could not be found.
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 90c87aa7-0b8a-438b-b1cb-c5bdd2ada7c2 could not be found. (HTTP 404) (Request-ID: req-3e013f7d-e429-4cdf-8db3-53f57b897733)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 90c87aa7-0b8a-438b-b1cb-c5bdd2ada7c2 could not be found.
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server [None req-a0ab23af-8c86-43ea-aa27-4363b88ea298 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver [None req-92d07c6f-952c-448b-b941-c78aff8efb42 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-c08e364a-2a12-4f1d-a834-2e6cd8e4e038)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 06:58:12 user nova-compute[72803]: ERROR nova.virt.libvirt.driver 
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server [None req-92d07c6f-952c-448b-b941-c78aff8efb42 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 06:58:12 user nova-compute[72803]: ERROR oslo_messaging.rpc.server 
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:13 user nova-compute[72803]: INFO nova.compute.manager [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Detaching volume 6f9e737b-e12f-41f4-8983-8c6b83d51518
Aug 15 06:58:13 user nova-compute[72803]: INFO nova.virt.block_device [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Attempting to driver detach volume 6f9e737b-e12f-41f4-8983-8c6b83d51518 from mountpoint /dev/vdb
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Attempting to detach device vdb from instance c94b60f1-bfc1-488a-9c12-255a15a29002 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 06:58:13 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:13 user nova-compute[72803]:   <source dev="/dev/sdi"/>
Aug 15 06:58:13 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:13 user nova-compute[72803]:   <serial>6f9e737b-e12f-41f4-8983-8c6b83d51518</serial>
Aug 15 06:58:13 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:58:13 user nova-compute[72803]: </disk>
Aug 15 06:58:13 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:58:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Successfully detached device vdb from instance c94b60f1-bfc1-488a-9c12-255a15a29002 from the persistent domain config.
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c94b60f1-bfc1-488a-9c12-255a15a29002 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 06:58:13 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:13 user nova-compute[72803]:   <source dev="/dev/sdi"/>
Aug 15 06:58:13 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:13 user nova-compute[72803]:   <serial>6f9e737b-e12f-41f4-8983-8c6b83d51518</serial>
Aug 15 06:58:13 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:58:13 user nova-compute[72803]: </disk>
Aug 15 06:58:13 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26464323136663430', 'path': '/dev/sdk'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464323136663430', 'path': '/dev/sdk'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lazy-loading 'flavor' on Instance uuid 2daeef6a-2d82-4d18-94ec-11fce8ed7479 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:58:13 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:13 user nova-compute[72803]:   <source dev="/dev/sdk"/>
Aug 15 06:58:13 user nova-compute[72803]:   <target dev="sdc" bus="scsi"/>
Aug 15 06:58:13 user nova-compute[72803]:   <serial>648eb379-a3dc-40b1-97c6-6629adad54bf</serial>
Aug 15 06:58:13 user nova-compute[72803]:   <address type="drive" controller="0" unit="2"/>
Aug 15 06:58:13 user nova-compute[72803]: </disk>
Aug 15 06:58:13 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692082693.6740146, c94b60f1-bfc1-488a-9c12-255a15a29002 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c94b60f1-bfc1-488a-9c12-255a15a29002 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:58:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Successfully detached device vdb from instance c94b60f1-bfc1-488a-9c12-255a15a29002 from the live domain config.
Aug 15 06:58:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHsvIuOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:13 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0281f318-8656-4140-bbef-bab289cf41af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8d44a-d553-4968-a0cf-e283827f01dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:13 user nova-compute[72803]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 (non-flash)
Aug 15 06:58:13 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c070ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518'): ({'sdi'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Removing single pathed devices sdi {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf581f54-5fad-4df1-9ad2-61f463b7afbd]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60ae31a-23f0-4128-bb99-419647fac929]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Flushing IO for device /dev/sdi {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c524e-2dd4-4a1c-b6f5-61d55fc4fc54]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe5147-b119-4a30-9b38-cd98054660e9]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] SCSI volumes sdi have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b96c76-4f6e-4b22-8ef0-17049af502f9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[86155cea-14c1-4fcc-8418-766cc597cee1]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518, portal: 172.16.0.220,3260]
Aug 15 06:58:14 user nova-compute[72803]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:14 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a14a8f-39ff-4a8b-a3ce-7d0467c2aa37]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] <== disconnect_volume: return (393ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] No BDM found with device name sda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] No VIF found with MAC fa:16:3e:7f:c7:c8, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG nova.objects.instance [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lazy-loading 'flavor' on Instance uuid c94b60f1-bfc1-488a-9c12-255a15a29002 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:14 user nova-compute[72803]: INFO nova.compute.manager [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Detaching volume 9cda6892-d024-4b8a-b05f-75066cd85472
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-675a40e6-f6f3-4240-a638-a27d1ad0e993 tempest-VolumesAssistedSnapshotsTest-1908587621 tempest-VolumesAssistedSnapshotsTest-1908587621-project-admin] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.918s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8004774d-618f-4547-b9df-32b1369772ea tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.886s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:15 user nova-compute[72803]: INFO nova.virt.block_device [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Attempting to driver detach volume 9cda6892-d024-4b8a-b05f-75066cd85472 from mountpoint /dev/vdb
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Attempting to detach device vdb from instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:58:15 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:15 user nova-compute[72803]:   <source dev="/dev/sdj"/>
Aug 15 06:58:15 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:15 user nova-compute[72803]:   <serial>9cda6892-d024-4b8a-b05f-75066cd85472</serial>
Aug 15 06:58:15 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:58:15 user nova-compute[72803]: </disk>
Aug 15 06:58:15 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:58:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Successfully detached device vdb from instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 from the persistent domain config.
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:58:15 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:15 user nova-compute[72803]:   <source dev="/dev/sdj"/>
Aug 15 06:58:15 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:15 user nova-compute[72803]:   <serial>9cda6892-d024-4b8a-b05f-75066cd85472</serial>
Aug 15 06:58:15 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:58:15 user nova-compute[72803]: </disk>
Aug 15 06:58:15 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.volume.cinder [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Update attachment failed for attachment dc544093-a82d-4174-b6cd-bbc7fb872a79. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 was not found.).). (HTTP 500) (Request-ID: req-774c990a-420d-4c7d-a9f3-dae4128c1f8e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 was not found.).). (HTTP 500) (Request-ID: req-774c990a-420d-4c7d-a9f3-dae4128c1f8e)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Failed to attach dcb10b8f-e260-4207-a24b-b681c2619b88 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 was not found.).). (HTTP 500) (Request-ID: req-774c990a-420d-4c7d-a9f3-dae4128c1f8e)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Traceback (most recent call last):
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     ret_val = method(obj, context, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     self._do_attach(context, instance, volume, volume_api,
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     self._volume_attach(context, volume, connector, instance,
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     connection_info = volume_api.attachment_update(
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     res = method(self, ctx, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     with excutils.save_and_reraise_exception():
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     self.force_reraise()
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     raise self.value
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     context, '3.44', skip_version_check=True).attachments.update(
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     return method.func(obj, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     resp = self._update('/attachments/%s' % id, body)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     return self._cs_request(url, 'PUT', **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     return self.request(url, method, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956]     raise exceptions.from_response(resp, body)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 was not found.).). (HTTP 500) (Request-ID: req-774c990a-420d-4c7d-a9f3-dae4128c1f8e)
Aug 15 06:58:15 user nova-compute[72803]: ERROR nova.compute.manager [instance: f015c02e-e530-4ec9-9fac-6efad4535956] 
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.328s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server [None req-6a208083-b1e4-4593-8f5c-1b551f0c41c3 tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 was not found.).). (HTTP 500) (Request-ID: req-774c990a-420d-4c7d-a9f3-dae4128c1f8e)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:dcb10b8f-e260-4207-a24b-b681c2619b88/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:6f9e737b-e12f-41f4-8983-8c6b83d51518 was not found.).). (HTTP 500) (Request-ID: req-774c990a-420d-4c7d-a9f3-dae4128c1f8e)
Aug 15 06:58:15 user nova-compute[72803]: ERROR oslo_messaging.rpc.server 
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:15 user nova-compute[72803]: INFO nova.compute.manager [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Detaching volume 648eb379-a3dc-40b1-97c6-6629adad54bf
Aug 15 06:58:15 user nova-compute[72803]: INFO nova.virt.block_device [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Attempting to driver detach volume 648eb379-a3dc-40b1-97c6-6629adad54bf from mountpoint /dev/sdc
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Attempting to detach device sdc from instance 2daeef6a-2d82-4d18-94ec-11fce8ed7479 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:58:15 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:15 user nova-compute[72803]:   <source dev="/dev/sdk"/>
Aug 15 06:58:15 user nova-compute[72803]:   <target dev="sdc" bus="scsi"/>
Aug 15 06:58:15 user nova-compute[72803]:   <serial>648eb379-a3dc-40b1-97c6-6629adad54bf</serial>
Aug 15 06:58:15 user nova-compute[72803]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 06:58:15 user nova-compute[72803]: </disk>
Aug 15 06:58:15 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:58:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Successfully detached device sdc from instance 2daeef6a-2d82-4d18-94ec-11fce8ed7479 from the persistent domain config.
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2daeef6a-2d82-4d18-94ec-11fce8ed7479 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:58:15 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:15 user nova-compute[72803]:   <source dev="/dev/sdk"/>
Aug 15 06:58:15 user nova-compute[72803]:   <target dev="sdc" bus="scsi"/>
Aug 15 06:58:15 user nova-compute[72803]:   <serial>648eb379-a3dc-40b1-97c6-6629adad54bf</serial>
Aug 15 06:58:15 user nova-compute[72803]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 06:58:15 user nova-compute[72803]: </disk>
Aug 15 06:58:15 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692082695.6776364, 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:58:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Successfully detached device vdb from instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 from the live domain config.
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztbJavXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:15 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fcb841-46fc-4b47-8d77-c79e28deda30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e2225e-25e4-4c9c-a8b9-b061304c9402]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:15 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:15 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:15 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e011db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472'): ({'sdj'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Removing single pathed devices sdj {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b7653d-2731-48f7-bdb4-572dcee9046c]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed26c8-36e7-46e0-bac1-47629603ccab]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Flushing IO for device /dev/sdj {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[150348fb-6fbe-4562-92fa-40b092d9af07]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.034s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4014d66a-5418-4b6b-bcbc-b4caf21465ee]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] SCSI volumes sdj have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[37069539-5ef1-4365-adf0-c92da8b1a38e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[899ca496-3769-493c-934a-8fd793f67cc8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472, portal: 172.16.0.220,3260]
Aug 15 06:58:15 user nova-compute[72803]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:15 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692082695.976855, 2daeef6a-2d82-4d18-94ec-11fce8ed7479 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2daeef6a-2d82-4d18-94ec-11fce8ed7479 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:58:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Successfully detached device sdc from instance 2daeef6a-2d82-4d18-94ec-11fce8ed7479 from the live domain config.
Aug 15 06:58:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVaxXBYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:15 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cda6892-d024-4b8a-b05f-75066cd85472 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[62763063-3aab-4014-8e71-d2f42ed7f118]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] <== disconnect_volume: return (319ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.027s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6f324e-400c-4b36-8a7c-a134c58f649c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c3db39-6696-497e-886b-b60449d93254]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c070f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf'): ({'sdk'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Removing single pathed devices sdk {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f3095-bf32-4cef-9afc-5f84ae4caecb]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7ae9a1-5d72-4e36-9f25-cae2fe442109]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Flushing IO for device /dev/sdk {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda2e435-43f6-4fbb-b851-330349a4cf75]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.046s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54ac2a9-7bfc-48dd-8812-e475a2db4237]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] SCSI volumes sdk have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:16 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d348720d-d24e-496e-92e9-ed39c53c4435]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[07148db8-fdb2-47f2-99f1-095f563bd2b7]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf, portal: 172.16.0.220,3260]
Aug 15 06:58:16 user nova-compute[72803]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:648eb379-a3dc-40b1-97c6-6629adad54bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a361d6ac-43a2-4342-95dd-a972f147e084]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] <== disconnect_volume: return (360ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.129s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:16 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:16 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e9910b-071d-4758-94ea-6ae63df2fbf3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:58:16 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13a5cee-a1df-4542-9b7c-14afea45eaa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5] added
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aaf65a-3b2c-4eb3-a2ce-800e417a3c6c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd72a61-aed2-4a78-bb92-830c5a7036b5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMolYfGq {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMolYfGq" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d319f7f-1071-43d2-8aa2-8d7d9dc81be2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CMolYfGq'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[905a4824-b9af-4dd8-9015-c97ee227203a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b5ea9c-8d78-442b-9ae9-4cef2d3670b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a237b983-fb43-41c1-952d-81b816ac366b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260]
Aug 15 06:58:16 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[366929bf-4755-4ccf-a364-b418a137bbaf]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf745dc-6a17-4ae6-a814-1020d42c5f8f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:16 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4fdc38-d9f2-4143-9657-f2d4d4deb0eb]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'flavor' on Instance uuid 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6de02be-d03f-45a8-8b3a-5342d9fc1f46 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.924s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:17 user nova-compute[72803]: DEBUG nova.objects.instance [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lazy-loading 'flavor' on Instance uuid 2daeef6a-2d82-4d18-94ec-11fce8ed7479 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-888a8110-566e-4f37-bd5d-8cbd73c18e40 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.642s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '23537626265383637', 'path': '/dev/sdi'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626265383637', 'path': '/dev/sdi'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:58:17 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lazy-loading 'flavor' on Instance uuid 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:58:17 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:17 user nova-compute[72803]:   <source dev="/dev/sdi"/>
Aug 15 06:58:17 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:17 user nova-compute[72803]:   <serial>547af602-6fdf-4a6b-b82e-af811864f6b5</serial>
Aug 15 06:58:17 user nova-compute[72803]: </disk>
Aug 15 06:58:17 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:18 user nova-compute[72803]: INFO nova.compute.manager [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Terminating instance
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] No VIF found with MAC fa:16:3e:87:01:db, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-f4d13fe4-3018-441e-a1f7-9e922d125e52 req-e890f6d0-5671-4bfd-b0ab-6e1803861a7c service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received event network-vif-unplugged-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f4d13fe4-3018-441e-a1f7-9e922d125e52 req-e890f6d0-5671-4bfd-b0ab-6e1803861a7c service nova] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f4d13fe4-3018-441e-a1f7-9e922d125e52 req-e890f6d0-5671-4bfd-b0ab-6e1803861a7c service nova] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f4d13fe4-3018-441e-a1f7-9e922d125e52 req-e890f6d0-5671-4bfd-b0ab-6e1803861a7c service nova] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-f4d13fe4-3018-441e-a1f7-9e922d125e52 req-e890f6d0-5671-4bfd-b0ab-6e1803861a7c service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] No waiting events found dispatching network-vif-unplugged-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-f4d13fe4-3018-441e-a1f7-9e922d125e52 req-e890f6d0-5671-4bfd-b0ab-6e1803861a7c service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received event network-vif-unplugged-1aea96c7-e182-4d42-87a3-d88c60d92608 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5a65d3b3-9b5b-41aa-b94e-2b8a4642fef1 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.813s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Instance destroyed successfully.
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lazy-loading 'resources' on Instance uuid 2daeef6a-2d82-4d18-94ec-11fce8ed7479 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-600877834',display_name='tempest-AttachSCSIVolumeTestJSON-server-600877834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-600877834',id=7,image_ref='3d1ff29e-abd4-430b-b7bb-64b49e14c0a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO12QGfS39J1/iISO/PGBUomCVksKDUGTanrGbB+FACcnpUlZExgRpV8+2TUdpIVQSLtR5udTcHkLohekflyL5KzMAozxB7Hy7lMr2GFQeLryTCFgzKSmn8+lC1JA3KwLg==',key_name='tempest-keypair-1400822134',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43f903ccf5114394b0f54c27459d4ef3',ramdisk_id='',reservation_id='r-pwevrcck',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3d1ff29e-abd4-430b-b7bb-64b49e14c0a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-81463321',owner_user_name='tempest-AttachSCSIVolumeTestJSON-81463321-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9d48395df784d0e9cf970dbef4d1ab2',uuid=2daeef6a-2d82-4d18-94ec-11fce8ed7479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Converting VIF {"id": "1aea96c7-e182-4d42-87a3-d88c60d92608", "address": "fa:16:3e:7f:c7:c8", "network": {"id": "a6e3f30e-72a6-4507-b033-58ba4343b6c1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-101831991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f903ccf5114394b0f54c27459d4ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aea96c7-e1", "ovs_interfaceid": "1aea96c7-e182-4d42-87a3-d88c60d92608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:c8,bridge_name='br-int',has_traffic_filtering=True,id=1aea96c7-e182-4d42-87a3-d88c60d92608,network=Network(a6e3f30e-72a6-4507-b033-58ba4343b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aea96c7-e1') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG os_vif [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:c8,bridge_name='br-int',has_traffic_filtering=True,id=1aea96c7-e182-4d42-87a3-d88c60d92608,network=Network(a6e3f30e-72a6-4507-b033-58ba4343b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aea96c7-e1') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aea96c7-e1, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:18 user nova-compute[72803]: INFO os_vif [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c7:c8,bridge_name='br-int',has_traffic_filtering=True,id=1aea96c7-e182-4d42-87a3-d88c60d92608,network=Network(a6e3f30e-72a6-4507-b033-58ba4343b6c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aea96c7-e1')
Aug 15 06:58:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Deleting instance files /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479_del
Aug 15 06:58:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Deletion of /opt/stack/data/nova/instances/2daeef6a-2d82-4d18-94ec-11fce8ed7479_del complete
Aug 15 06:58:18 user nova-compute[72803]: INFO nova.compute.manager [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 06:58:18 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:58:18 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:19 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Took 0.90 seconds to deallocate network for instance.
Aug 15 06:58:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-bbd2514d-81b2-4fbb-98be-a91798f1439e req-eb911fbc-21e1-428f-836d-ec92822b531b service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received event network-vif-deleted-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG os_brick.utils [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b477d829-565f-491e-93de-133987b09d6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b1d95f-6c6a-4a6a-be0e-12121b286ff2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[13209c86-1e2c-4868-8f32-ddf6b829654d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd034c0-26c7-41db-a61a-c2926a0bdb95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:20 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c9867f-facb-4a5c-b71c-7666b3e398ce]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG os_brick.utils [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:20 user nova-compute[72803]: INFO nova.compute.manager [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Swapping volume 547af602-6fdf-4a6b-b82e-af811864f6b5 for 41507c5b-b341-4da6-ac3a-003817964f6b
Aug 15 06:58:20 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:20 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Deleted allocations for instance 2daeef6a-2d82-4d18-94ec-11fce8ed7479
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d5b766da-aacf-4689-9bcd-312ffea92ed2 tempest-AttachSCSIVolumeTestJSON-81463321 tempest-AttachSCSIVolumeTestJSON-81463321-project-member] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-1967b32c-e0ad-4f09-9bb3-6105963e70bb req-965a526c-e6a4-4b77-8a3d-3f8a399ab109 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received event network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1967b32c-e0ad-4f09-9bb3-6105963e70bb req-965a526c-e6a4-4b77-8a3d-3f8a399ab109 service nova] Acquiring lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1967b32c-e0ad-4f09-9bb3-6105963e70bb req-965a526c-e6a4-4b77-8a3d-3f8a399ab109 service nova] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1967b32c-e0ad-4f09-9bb3-6105963e70bb req-965a526c-e6a4-4b77-8a3d-3f8a399ab109 service nova] Lock "2daeef6a-2d82-4d18-94ec-11fce8ed7479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-1967b32c-e0ad-4f09-9bb3-6105963e70bb req-965a526c-e6a4-4b77-8a3d-3f8a399ab109 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] No waiting events found dispatching network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:20 user nova-compute[72803]: WARNING nova.compute.manager [req-1967b32c-e0ad-4f09-9bb3-6105963e70bb req-965a526c-e6a4-4b77-8a3d-3f8a399ab109 service nova] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Received unexpected event network-vif-plugged-1aea96c7-e182-4d42-87a3-d88c60d92608 for instance with vm_state deleted and task_state None.
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:58:20 user nova-compute[72803]: INFO nova.compute.claims [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Claim successful on node user
Aug 15 06:58:21 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:58:21 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:58:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:58:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:58:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:58:21 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:58:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:58:21 user nova-compute[72803]: DEBUG nova.policy [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc7ee5090ba54d4b8acbd4c9f84835f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ede5bd5cb24059bc4a185badef865d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:58:21 user nova-compute[72803]: INFO nova.virt.block_device [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Booting with blank volume at /dev/vda
Aug 15 06:58:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Successfully created port: 8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Successfully updated port: 8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquired lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-cbc47bae-4ce3-453e-bc50-9ed894fd43af req-2a55d479-eb07-434c-8638-e5795225c944 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-changed-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-cbc47bae-4ce3-453e-bc50-9ed894fd43af req-2a55d479-eb07-434c-8638-e5795225c944 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Refreshing instance network info cache due to event network-changed-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cbc47bae-4ce3-453e-bc50-9ed894fd43af req-2a55d479-eb07-434c-8638-e5795225c944 service nova] Acquiring lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updating instance_info_cache with network_info: [{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Releasing lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance network_info: |[{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cbc47bae-4ce3-453e-bc50-9ed894fd43af req-2a55d479-eb07-434c-8638-e5795225c944 service nova] Acquired lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-cbc47bae-4ce3-453e-bc50-9ed894fd43af req-2a55d479-eb07-434c-8638-e5795225c944 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Refreshing network info cache for port 8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-cbc47bae-4ce3-453e-bc50-9ed894fd43af req-2a55d479-eb07-434c-8638-e5795225c944 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updated VIF entry in instance network info cache for port 8a8e9364-b7d1-4faf-9133-bd7c07abe0fa. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-cbc47bae-4ce3-453e-bc50-9ed894fd43af req-2a55d479-eb07-434c-8638-e5795225c944 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updating instance_info_cache with network_info: [{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cbc47bae-4ce3-453e-bc50-9ed894fd43af req-2a55d479-eb07-434c-8638-e5795225c944 service nova] Releasing lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:58:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:58:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updating instance_info_cache with network_info: [{"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-ff252c72-caf0-4c90-b078-6aab5a0b1fab" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG os_brick.utils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d5e76e-312a-4c68-a962-ddc9cd7e8c25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0be80-e1bb-4a28-ab4b-a622f5512015]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f75dd4-f3ad-4245-b4f2-f884fecc57a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[627d3dbe-765e-40f6-9edc-9f3cf6a506a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:27 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d31f172-72a5-4c71-9b63-55eebe3b4d22]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG os_brick.utils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updating existing volume attachment record: 11bb6fe7-ad63-48fb-9720-daabc179ab95 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:58:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG nova.compute.manager [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUfmknub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0cb66e88-04aa-47cb-b403-16e16704a9f9', 'attached_at': '', 'detached_at': '', 'volume_id': '41507c5b-b341-4da6-ac3a-003817964f6b', 'serial': '41507c5b-b341-4da6-ac3a-003817964f6b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '0cb66e88-04aa-47cb-b403-16e16704a9f9', 'attached_at': '', 'detached_at': '', 'volume_id': '547af602-6fdf-4a6b-b82e-af811864f6b5', 'serial'} {{(pid=72803) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUfmknub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:30 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:30 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:30 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a33491d-c3da-40b9-884c-44ebb23af3c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:58:30 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b46a8-888e-48e2-b94f-fe7003772b60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b] added
Aug 15 06:58:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[75755e00-d39b-44a2-a040-79e113a1c26d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7eab42-a153-4067-be75-167d50efcc27]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WUfmknub {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WUfmknub" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[83265002-36dc-4fe8-a15c-8250abfb9fe1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WUfmknub'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2cef88-0a5d-4a60-b2d0-4bd3d2e775a6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da4b1c5-34da-4913-a4a0-b7ea6992d702]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c2bd56-7244-4ea0-8998-91cdc7aa95f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b, portal: 172.16.0.220,3260]
Aug 15 06:58:30 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef4c41-8efa-4f3f-8652-a62f179ddda4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3a3cc1-5d9f-40f9-b822-72ae4c52446f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:30 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1416a2c2-442a-4a07-8602-d55d51544523]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUfmknub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23662373163353139', 'path': '/dev/sdj'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662373163353139', 'path': '/dev/sdj'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG nova.objects.instance [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lazy-loading 'flavor' on Instance uuid 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:58:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:58:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:58:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:32 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:58:32 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:58:32 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=6859MB free_disk=25.610122680664062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:58:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f015c02e-e530-4ec9-9fac-6efad4535956 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance d543c8cd-83cf-4474-a35d-f3c7b7f08093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ff252c72-caf0-4c90-b078-6aab5a0b1fab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 7d3ab35f-ec73-444d-9cc3-e62213f19918 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance cec4b0a2-dcfd-418e-af89-d0289651dd0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c94b60f1-bfc1-488a-9c12-255a15a29002 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 439353344 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082698.7731876, 2daeef6a-2d82-4d18-94ec-11fce8ed7479 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:58:33 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] VM Stopped (Lifecycle Event)
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.855s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2b338954-845f-4083-9402-f9959ef192b9 None None] [instance: 2daeef6a-2d82-4d18-94ec-11fce8ed7479] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:58:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 614465536 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 792723456 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 975175680 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:35 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7732ac3a-1754-413d-bb40-899998c8b8f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec4294f-0575-4860-ad8f-846312f27fee]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:35 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:35 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:35 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c078e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'): ({'sdi'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Removing single pathed devices sdi {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b10da34-b686-4262-a586-8de4bab05b60]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b5ac42-5fdf-4cf7-8cd5-2687c7ce1a27]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Flushing IO for device /dev/sdi {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f9726e-0ef6-422b-8046-5db153fb596d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f517c47-2ad7-45e6-a517-41483754cb55]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] SCSI volumes sdi have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c313db1f-2c99-4242-9c2b-1a7f71e7921e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaadb023-0a57-41fe-bf90-5de7cd99e9b2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260]
Aug 15 06:58:35 user nova-compute[72803]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:35 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ca4c14-f1c6-4961-a66c-ef0a2bab3ed0]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] <== disconnect_volume: return (314ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUfmknub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '0cb66e88-04aa-47cb-b403-16e16704a9f9', 'attached_at': '', 'detached_at': '', 'volume_id': '41507c5b-b341-4da6-ac3a-003817964f6b', 'serial'} {{(pid=72803) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 06:58:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] swap_volume: removing Cinder connection for volume 547af602-6fdf-4a6b-b82e-af811864f6b5 {{(pid=72803) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 06:58:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] swap_volume: Updating volume 547af602-6fdf-4a6b-b82e-af811864f6b5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "WUfmknub", "auth_password": "s9GBRN3HMd52Yi", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "41507c5b-b341-4da6-ac3a-003817964f6b"}, "status": "reserved", "instance": "0cb66e88-04aa-47cb-b403-16e16704a9f9", "attached_at": "", "detached_at": "", "volume_id": "41507c5b-b341-4da6-ac3a-003817964f6b", "serial": "41507c5b-b341-4da6-ac3a-003817964f6b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '41507c5b-b341-4da6-ac3a-003817964f6b', 'no_device': None, 'attachment_id': '08e8c62d-3b29-4e8f-9d44-69ddc020343e'} {{(pid=72803) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 06:58:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0947fe21-5291-4135-be3e-79e8ac4c270d tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.837s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG os_brick.utils [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[596ec2b2-908a-4988-86e2-3367af0525bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2841ca3-f1a3-40b5-8e1e-f9ccdbecee76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec03fcc-352d-4e1b-b162-b8349087fd08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4874f3-3a9d-4c5a-b55f-12d53e9165e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:58:37 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:58:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[531cb1e6-3da0-4c41-ad12-f8897d072937]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:58:37 user nova-compute[72803]: DEBUG os_brick.utils [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:37 user nova-compute[72803]: INFO nova.compute.manager [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Swapping volume 41507c5b-b341-4da6-ac3a-003817964f6b for 547af602-6fdf-4a6b-b82e-af811864f6b5
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:58:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Creating image(s)
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Ensure instance console log exists: /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Start _get_guest_xml network_info=[{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '11bb6fe7-ad63-48fb-9720-daabc179ab95', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdFWucmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4a01678-2255-4fb5-a497-1ceaab81422a', 'attached_at': '', 'detached_at': '', 'volume_id': '951d2906-a088-45d0-928d-baa14cee31b9', 'serial': '951d2906-a088-45d0-928d-baa14cee31b9'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:58:38 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:58:38 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdFWucmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:38 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:38 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:38 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[91882d32-05ea-42aa-952c-104b2af91fab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:58:38 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4531d2-7956-4916-a949-047648022c92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9] added
Aug 15 06:58:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d87587-eadd-42c0-96fb-aa1a81bec8d6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd89cd-2dfc-4005-a708-420939af05e1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdFWucmI {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdFWucmI" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d927d-5ad5-41d7-b2b6-fae8408298e8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BdFWucmI'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08aa17a-0fc1-42ac-9250-3afe7aad58a5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd6e501-3998-416b-908d-3bab5bd139ed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c344df8-dc87-440b-a3d3-0eb8e722470a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9, portal: 172.16.0.220,3260]
Aug 15 06:58:38 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d065fb45-c58f-4caa-81b4-d86fd6451a38]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6fc067-0e55-4538-a05b-89b834c3513c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:38 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2856d2ac-f89c-4829-98f6-a10b15d2394c]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdFWucmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23532346265303663', 'path': '/dev/sdi'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532346265303663', 'path': '/dev/sdi'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:58:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1334484337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1334484337',id=14,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-qxngkyu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:58:21Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=a4a01678-2255-4fb5-a497-1ceaab81422a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:30:72,bridge_name='br-int',has_traffic_filtering=True,id=8a8e9364-b7d1-4faf-9133-bd7c07abe0fa,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8e9364-b7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.objects.instance [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'pci_devices' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:58:39 user nova-compute[72803]:   <uuid>a4a01678-2255-4fb5-a497-1ceaab81422a</uuid>
Aug 15 06:58:39 user nova-compute[72803]:   <name>instance-0000000e</name>
Aug 15 06:58:39 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:58:39 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:58:39 user nova-compute[72803]:   <metadata>
Aug 15 06:58:39 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:58:39 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:58:39 user nova-compute[72803]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1334484337</nova:name>
Aug 15 06:58:39 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:58:38</nova:creationTime>
Aug 15 06:58:39 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:58:39 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:58:39 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:58:39 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:58:39 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:58:39 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:58:39 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:58:39 user nova-compute[72803]:       <nova:owner>
Aug 15 06:58:39 user nova-compute[72803]:         <nova:user uuid="bc7ee5090ba54d4b8acbd4c9f84835f3">tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member</nova:user>
Aug 15 06:58:39 user nova-compute[72803]:         <nova:project uuid="07ede5bd5cb24059bc4a185badef865d">tempest-ServerBootFromVolumeStableRescueTest-1860507335</nova:project>
Aug 15 06:58:39 user nova-compute[72803]:       </nova:owner>
Aug 15 06:58:39 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:58:39 user nova-compute[72803]:       <nova:ports>
Aug 15 06:58:39 user nova-compute[72803]:         <nova:port uuid="8a8e9364-b7d1-4faf-9133-bd7c07abe0fa">
Aug 15 06:58:39 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 06:58:39 user nova-compute[72803]:         </nova:port>
Aug 15 06:58:39 user nova-compute[72803]:       </nova:ports>
Aug 15 06:58:39 user nova-compute[72803]:     </nova:instance>
Aug 15 06:58:39 user nova-compute[72803]:   </metadata>
Aug 15 06:58:39 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:58:39 user nova-compute[72803]:     <system>
Aug 15 06:58:39 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:58:39 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:58:39 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:58:39 user nova-compute[72803]:       <entry name="serial">a4a01678-2255-4fb5-a497-1ceaab81422a</entry>
Aug 15 06:58:39 user nova-compute[72803]:       <entry name="uuid">a4a01678-2255-4fb5-a497-1ceaab81422a</entry>
Aug 15 06:58:39 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:58:39 user nova-compute[72803]:     </system>
Aug 15 06:58:39 user nova-compute[72803]:   </sysinfo>
Aug 15 06:58:39 user nova-compute[72803]:   <os>
Aug 15 06:58:39 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:58:39 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:58:39 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:58:39 user nova-compute[72803]:   </os>
Aug 15 06:58:39 user nova-compute[72803]:   <features>
Aug 15 06:58:39 user nova-compute[72803]:     <acpi/>
Aug 15 06:58:39 user nova-compute[72803]:     <apic/>
Aug 15 06:58:39 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:58:39 user nova-compute[72803]:   </features>
Aug 15 06:58:39 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:58:39 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:58:39 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:58:39 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:58:39 user nova-compute[72803]:   </clock>
Aug 15 06:58:39 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:58:39 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:58:39 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:58:39 user nova-compute[72803]:   </cpu>
Aug 15 06:58:39 user nova-compute[72803]:   <devices>
Aug 15 06:58:39 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 06:58:39 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:39 user nova-compute[72803]:       <source dev="/dev/sdi"/>
Aug 15 06:58:39 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:58:39 user nova-compute[72803]:       <serial>951d2906-a088-45d0-928d-baa14cee31b9</serial>
Aug 15 06:58:39 user nova-compute[72803]:     </disk>
Aug 15 06:58:39 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:58:39 user nova-compute[72803]:       <mac address="fa:16:3e:de:30:72"/>
Aug 15 06:58:39 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:58:39 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:58:39 user nova-compute[72803]:       <target dev="tap8a8e9364-b7"/>
Aug 15 06:58:39 user nova-compute[72803]:     </interface>
Aug 15 06:58:39 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:58:39 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/console.log" append="off"/>
Aug 15 06:58:39 user nova-compute[72803]:     </serial>
Aug 15 06:58:39 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:58:39 user nova-compute[72803]:     <video>
Aug 15 06:58:39 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:58:39 user nova-compute[72803]:     </video>
Aug 15 06:58:39 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:58:39 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:58:39 user nova-compute[72803]:     </rng>
Aug 15 06:58:39 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:58:39 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:58:39 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:58:39 user nova-compute[72803]:     </memballoon>
Aug 15 06:58:39 user nova-compute[72803]:   </devices>
Aug 15 06:58:39 user nova-compute[72803]: </domain>
Aug 15 06:58:39 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:58:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1334484337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1334484337',id=14,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-qxngkyu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:58:21Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=a4a01678-2255-4fb5-a497-1ceaab81422a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:30:72,bridge_name='br-int',has_traffic_filtering=True,id=8a8e9364-b7d1-4faf-9133-bd7c07abe0fa,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8e9364-b7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG os_vif [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:30:72,bridge_name='br-int',has_traffic_filtering=True,id=8a8e9364-b7d1-4faf-9133-bd7c07abe0fa,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8e9364-b7') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a8e9364-b7, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a8e9364-b7, col_values=(('external_ids', {'iface-id': '8a8e9364-b7d1-4faf-9133-bd7c07abe0fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:30:72', 'vm-uuid': 'a4a01678-2255-4fb5-a497-1ceaab81422a'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:39 user nova-compute[72803]: INFO os_vif [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:30:72,bridge_name='br-int',has_traffic_filtering=True,id=8a8e9364-b7d1-4faf-9133-bd7c07abe0fa,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8e9364-b7')
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:58:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No VIF found with MAC fa:16:3e:de:30:72, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:58:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-52c0f183-317a-4b9f-8484-23b3106ec2cf req-d7801b40-fd85-4875-938c-c52a5dc39716 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-changed-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-52c0f183-317a-4b9f-8484-23b3106ec2cf req-d7801b40-fd85-4875-938c-c52a5dc39716 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing instance network info cache due to event network-changed-66f37461-2446-4ec8-acaa-a6728062d656. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:58:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-52c0f183-317a-4b9f-8484-23b3106ec2cf req-d7801b40-fd85-4875-938c-c52a5dc39716 service nova] Acquiring lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-52c0f183-317a-4b9f-8484-23b3106ec2cf req-d7801b40-fd85-4875-938c-c52a5dc39716 service nova] Acquired lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-52c0f183-317a-4b9f-8484-23b3106ec2cf req-d7801b40-fd85-4875-938c-c52a5dc39716 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Refreshing network info cache for port 66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:58:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-52c0f183-317a-4b9f-8484-23b3106ec2cf req-d7801b40-fd85-4875-938c-c52a5dc39716 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updated VIF entry in instance network info cache for port 66f37461-2446-4ec8-acaa-a6728062d656. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:58:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-52c0f183-317a-4b9f-8484-23b3106ec2cf req-d7801b40-fd85-4875-938c-c52a5dc39716 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [{"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-52c0f183-317a-4b9f-8484-23b3106ec2cf req-d7801b40-fd85-4875-938c-c52a5dc39716 service nova] Releasing lock "refresh_cache-cec4b0a2-dcfd-418e-af89-d0289651dd0d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG nova.compute.manager [req-b0e6da7d-9b84-4e16-80fe-de0915f749e8 req-44c023f4-049f-41c4-80d3-121c73d0b34b service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b0e6da7d-9b84-4e16-80fe-de0915f749e8 req-44c023f4-049f-41c4-80d3-121c73d0b34b service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b0e6da7d-9b84-4e16-80fe-de0915f749e8 req-44c023f4-049f-41c4-80d3-121c73d0b34b service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b0e6da7d-9b84-4e16-80fe-de0915f749e8 req-44c023f4-049f-41c4-80d3-121c73d0b34b service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:41 user nova-compute[72803]: DEBUG nova.compute.manager [req-b0e6da7d-9b84-4e16-80fe-de0915f749e8 req-44c023f4-049f-41c4-80d3-121c73d0b34b service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:41 user nova-compute[72803]: WARNING nova.compute.manager [req-b0e6da7d-9b84-4e16-80fe-de0915f749e8 req-44c023f4-049f-41c4-80d3-121c73d0b34b service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state building and task_state spawning.
Aug 15 06:58:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:42 user nova-compute[72803]: INFO nova.compute.manager [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Terminating instance
Aug 15 06:58:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-7e084451-8d21-4392-a22d-1d3741955ea3 req-e44bb1e4-8ff5-49de-865b-567eecdfb301 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7e084451-8d21-4392-a22d-1d3741955ea3 req-e44bb1e4-8ff5-49de-865b-567eecdfb301 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7e084451-8d21-4392-a22d-1d3741955ea3 req-e44bb1e4-8ff5-49de-865b-567eecdfb301 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7e084451-8d21-4392-a22d-1d3741955ea3 req-e44bb1e4-8ff5-49de-865b-567eecdfb301 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-7e084451-8d21-4392-a22d-1d3741955ea3 req-e44bb1e4-8ff5-49de-865b-567eecdfb301 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-unplugged-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-7e084451-8d21-4392-a22d-1d3741955ea3 req-e44bb1e4-8ff5-49de-865b-567eecdfb301 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-9890d264-59a1-45c6-ae4e-38d4c247d002 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082723.3198068, a4a01678-2255-4fb5-a497-1ceaab81422a => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:58:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] VM Resumed (Lifecycle Event)
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance spawned successfully.
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:58:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082723.3229032, a4a01678-2255-4fb5-a497-1ceaab81422a => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:58:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] VM Started (Lifecycle Event)
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:58:43 user nova-compute[72803]: INFO nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:43 user nova-compute[72803]: WARNING nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state building and task_state spawning.
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-unplugged-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-66f37461-2446-4ec8-acaa-a6728062d656 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:43 user nova-compute[72803]: WARNING nova.compute.manager [req-efc4ad83-a4bd-45c8-bfdd-e37ce603900f req-b0e430e8-d161-435e-8761-0ec908398892 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-66f37461-2446-4ec8-acaa-a6728062d656 for instance with vm_state active and task_state deleting.
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: INFO nova.compute.manager [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Took 22.70 seconds to build instance.
Aug 15 06:58:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04731f25-06d1-44a2-acdb-c1b5afbd7533 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.813s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Instance destroyed successfully.
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lazy-loading 'resources' on Instance uuid cec4b0a2-dcfd-418e-af89-d0289651dd0d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:df:48,bridge_name='br-int',has_traffic_filtering=True,id=66f37461-2446-4ec8-acaa-a6728062d656,network=Network(55f3fbac-a266-4911-9685-0cdc83d1d58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f37461-24') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:df:48,bridge_name='br-int',has_traffic_filtering=True,id=66f37461-2446-4ec8-acaa-a6728062d656,network=Network(55f3fbac-a266-4911-9685-0cdc83d1d58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f37461-24') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66f37461-24, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: INFO os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:df:48,bridge_name='br-int',has_traffic_filtering=True,id=66f37461-2446-4ec8-acaa-a6728062d656,network=Network(55f3fbac-a266-4911-9685-0cdc83d1d58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f37461-24')
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:29,bridge_name='br-int',has_traffic_filtering=True,id=9890d264-59a1-45c6-ae4e-38d4c247d002,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9890d264-59') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:29,bridge_name='br-int',has_traffic_filtering=True,id=9890d264-59a1-45c6-ae4e-38d4c247d002,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9890d264-59') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9890d264-59, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: INFO os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:4d:29,bridge_name='br-int',has_traffic_filtering=True,id=9890d264-59a1-45c6-ae4e-38d4c247d002,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9890d264-59')
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:72:a2,bridge_name='br-int',has_traffic_filtering=True,id=544213fa-d329-4fdc-932f-e0e66c659e9a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap544213fa-d3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:72:a2,bridge_name='br-int',has_traffic_filtering=True,id=544213fa-d329-4fdc-932f-e0e66c659e9a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap544213fa-d3') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap544213fa-d3, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: INFO os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:72:a2,bridge_name='br-int',has_traffic_filtering=True,id=544213fa-d329-4fdc-932f-e0e66c659e9a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap544213fa-d3')
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=cbc79d7d-12af-4c59-bb93-571748f8620a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc79d7d-12') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=cbc79d7d-12af-4c59-bb93-571748f8620a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc79d7d-12') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbc79d7d-12, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: INFO os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:21:a7,bridge_name='br-int',has_traffic_filtering=True,id=cbc79d7d-12af-4c59-bb93-571748f8620a,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc79d7d-12')
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:87:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e77e94b-cd4d-40b4-924f-10f67266d802,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e77e94b-cd') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:87:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e77e94b-cd4d-40b4-924f-10f67266d802,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e77e94b-cd') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e77e94b-cd, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: INFO os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:87:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e77e94b-cd4d-40b4-924f-10f67266d802,network=Network(d0a7d005-9336-4427-9b99-555a344e6dae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e77e94b-cd')
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "address": "fa:16:3e:c2:7f:7b", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9ad424-18", "ovs_interfaceid": "9a9ad424-1879-420f-ad8e-960e1ae78d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7f:7b,bridge_name='br-int',has_traffic_filtering=True,id=9a9ad424-1879-420f-ad8e-960e1ae78d3b,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9ad424-18') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7f:7b,bridge_name='br-int',has_traffic_filtering=True,id=9a9ad424-1879-420f-ad8e-960e1ae78d3b,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9ad424-18') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a9ad424-18, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: INFO os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:7f:7b,bridge_name='br-int',has_traffic_filtering=True,id=9a9ad424-1879-420f-ad8e-960e1ae78d3b,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9ad424-18')
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664563546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1664563546',id=10,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIutXLgH1WOmooTCvDe2cqCef2lzXfDYQHfKGW1kCN4sjZeB1sG5dgmBYD/YLKfc+wfZUNMiCWuvPbUa2R36HvFJ2fSDItAl4tGQCfGYq7MvN/W5mnAcDoymgtGJAZ2kOg==',key_name='tempest-keypair-1504995355',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4c3886587c54c7281d4da2afb3ddadc',ramdisk_id='',reservation_id='r-9ed36ivo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-935268704',owner_user_name='tempest-TaggedBootDevicesTest-935268704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27bed5c19c0e4872a755ba7350ee1d40',uuid=cec4b0a2-dcfd-418e-af89-d0289651dd0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converting VIF {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:11,bridge_name='br-int',has_traffic_filtering=True,id=73595875-33de-4f73-a8bd-a939ef40aa34,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73595875-33') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:11,bridge_name='br-int',has_traffic_filtering=True,id=73595875-33de-4f73-a8bd-a939ef40aa34,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73595875-33') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73595875-33, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:44 user nova-compute[72803]: INFO os_vif [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:0a:11,bridge_name='br-int',has_traffic_filtering=True,id=73595875-33de-4f73-a8bd-a939ef40aa34,network=Network(0bd50eea-e06d-4376-885a-7c21927f19a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73595875-33')
Aug 15 06:58:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AREdQGJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:44 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af20901-e937-4ee5-ba44-46562ccd4d25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ea95aa-2c82-4231-a424-ac60b66f1f7d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:44 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f350d12b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a5739e-6921-47b2-b423-57ea4aaab257]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c937f90-97db-46e6-bce8-a9d452c5085f]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4440ba3c-d899-40ae-94a0-a39c1577db58]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c396b4-5c6d-4cc8-8763-c7cd98ddce01]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74b3e4f-b4ee-42a8-8928-6a756e9405b0]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac89482-2607-4a4d-a887-110fcca84350]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74, portal: 172.16.0.220,3260]
Aug 15 06:58:44 user nova-compute[72803]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d64473-73bb-4f84-8c63-4c7442dc9c74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d173423b-3cb7-4e3f-a412-2d266abf93fa]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== disconnect_volume: return (346ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGmAwapt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:45 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bea035-b742-4d73-8807-384ccddac4a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b7c57-d4af-4610-8134-503615f5fb32]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:45 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:45 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c070edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbae204-a9a9-423b-a364-5dd28904cfcd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c0818c-906b-4c08-a270-ffa0c2398d7a]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b600e4-155a-449a-8e96-631352e04e5b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: WARNING nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-9890d264-59a1-45c6-ae4e-38d4c247d002 for instance with vm_state active and task_state deleting.
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-unplugged-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-544213fa-d329-4fdc-932f-e0e66c659e9a for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: WARNING nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-544213fa-d329-4fdc-932f-e0e66c659e9a for instance with vm_state active and task_state deleting.
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-unplugged-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-8e77e94b-cd4d-40b4-924f-10f67266d802 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: WARNING nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-8e77e94b-cd4d-40b4-924f-10f67266d802 for instance with vm_state active and task_state deleting.
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-unplugged-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-73595875-33de-4f73-a8bd-a939ef40aa34 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: WARNING nova.compute.manager [req-ff7f53e0-7468-4cd6-9bd7-b441a25f5996 req-62543bea-5a7b-4e4e-b557-2441efa2b02a service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-73595875-33de-4f73-a8bd-a939ef40aa34 for instance with vm_state active and task_state deleting.
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2360588-e587-4259-bb6e-d88779e4e240]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa27e1de-3336-4bf0-86c2-2350c4b1b43a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9c2358-9d62-4cad-ad56-7272b74bd41e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41, portal: 172.16.0.220,3260]
Aug 15 06:58:45 user nova-compute[72803]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:45 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:824038eb-18f8-46c0-9c21-6f9719d8fd41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1f2609-6b8c-4787-8a9a-e532fbe4f8c6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== disconnect_volume: return (324ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIlwNYqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:45 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b284e276-8e43-4a96-a691-b6e45331af77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8a191-1282-461a-b71b-1b45f71b44b1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:45 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:45 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:45 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c070edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c01f1c2-2289-4e74-ae8c-64bd1e268efb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40e03a8-9a79-4064-a577-9ff1eeae3615]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c35b06b-75ad-49be-b664-6767fcbb5619]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6059a610-0de6-4e7e-95ec-5f9145030711]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1422ffe5-5b2e-425c-8481-1d2e5cb19ac8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-unplugged-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-cbc79d7d-12af-4c59-bb93-571748f8620a for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: WARNING nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-cbc79d7d-12af-4c59-bb93-571748f8620a for instance with vm_state active and task_state deleting.
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-unplugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-unplugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Acquiring lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] No waiting events found dispatching network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:45 user nova-compute[72803]: WARNING nova.compute.manager [req-2ffb1d98-e2e9-4f0c-bb60-f3c55078a564 req-550168ce-28e9-4eeb-a449-8722e76e96e0 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received unexpected event network-vif-plugged-9a9ad424-1879-420f-ad8e-960e1ae78d3b for instance with vm_state active and task_state deleting.
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f9cb2-bd22-498e-918b-fa8103b8039f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc, portal: 172.16.0.220,3260]
Aug 15 06:58:45 user nova-compute[72803]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:45 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78be5ee-b0c3-444f-a4e0-27a63db565cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46be3ac-db60-44c1-acff-a797d9a7c1d3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] <== disconnect_volume: return (300ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:45 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Deleting instance files /opt/stack/data/nova/instances/cec4b0a2-dcfd-418e-af89-d0289651dd0d_del
Aug 15 06:58:45 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Deletion of /opt/stack/data/nova/instances/cec4b0a2-dcfd-418e-af89-d0289651dd0d_del complete
Aug 15 06:58:45 user nova-compute[72803]: INFO nova.compute.manager [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Took 3.15 seconds to destroy the instance on the hypervisor.
Aug 15 06:58:45 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:58:45 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:58:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-0d7389ef-a05f-43a1-a404-d3ff1fd7f376 req-e8ae5c15-f86e-44eb-ad9a-ecafce51fa5a service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-changed-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-0d7389ef-a05f-43a1-a404-d3ff1fd7f376 req-e8ae5c15-f86e-44eb-ad9a-ecafce51fa5a service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing instance network info cache due to event network-changed-7ef268dd-8261-4e19-a09e-f1a5ccb4a036. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:58:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0d7389ef-a05f-43a1-a404-d3ff1fd7f376 req-e8ae5c15-f86e-44eb-ad9a-ecafce51fa5a service nova] Acquiring lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:58:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0d7389ef-a05f-43a1-a404-d3ff1fd7f376 req-e8ae5c15-f86e-44eb-ad9a-ecafce51fa5a service nova] Acquired lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:58:47 user nova-compute[72803]: DEBUG nova.network.neutron [req-0d7389ef-a05f-43a1-a404-d3ff1fd7f376 req-e8ae5c15-f86e-44eb-ad9a-ecafce51fa5a service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Refreshing network info cache for port 7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0cb66e88-04aa-47cb-b403-16e16704a9f9', 'attached_at': '', 'detached_at': '', 'volume_id': '547af602-6fdf-4a6b-b82e-af811864f6b5', 'serial': '547af602-6fdf-4a6b-b82e-af811864f6b5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUfmknub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '41507c5b-b341-4da6-ac3a-003817964f6b'}, 'status': 'reserved', 'instance': '0cb66e88-04aa-47cb-b403-16e16704a9f9', 'attached_at': '', 'detached_at': '', 'volume_id': '41507c5b-b341-4da6-ac3a-003817964f6b', 'serial'} {{(pid=72803) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:48 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:48 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:48 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa20fea-99c8-4515-88d9-3e4805badc17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:58:48 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[978de3c0-b04a-4fab-b474-15bd17737a1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5] added
Aug 15 06:58:48 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[26029c46-062d-4dff-9b09-5e538c73b59d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb82b14-5cd9-4113-a45d-a4791b7594f5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMolYfGq {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG nova.network.neutron [req-0d7389ef-a05f-43a1-a404-d3ff1fd7f376 req-e8ae5c15-f86e-44eb-ad9a-ecafce51fa5a service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updated VIF entry in instance network info cache for port 7ef268dd-8261-4e19-a09e-f1a5ccb4a036. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG nova.network.neutron [req-0d7389ef-a05f-43a1-a404-d3ff1fd7f376 req-e8ae5c15-f86e-44eb-ad9a-ecafce51fa5a service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [{"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMolYfGq" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2fff6c-6aa6-43a1-b9a4-d3950633a1a9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CMolYfGq'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0d7389ef-a05f-43a1-a404-d3ff1fd7f376 req-e8ae5c15-f86e-44eb-ad9a-ecafce51fa5a service nova] Releasing lock "refresh_cache-7d3ab35f-ec73-444d-9cc3-e62213f19918" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a463fa32-dc1f-4df9-a964-a12ba079a5b9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1033908-d59c-40e6-995b-3fe4a1772614]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:48 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:48 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[61abebf7-6cc6-4b70-8f43-c7c43b3d701e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260]
Aug 15 06:58:48 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:48 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0d6266-a84f-452b-968d-4787c79890fa]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1340f0c-92da-4a06-ba11-8d4c5c73d866]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:48 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:48 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:48 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e649c168-4a29-4eba-8c70-ffc25d32e41a]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:58:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-ae5fdf89-edf2-4052-ba89-ae48509132b8 req-b69c7072-6037-4757-bb52-529c87712b07 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-deleted-9a9ad424-1879-420f-ad8e-960e1ae78d3b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:49 user nova-compute[72803]: INFO nova.compute.manager [req-ae5fdf89-edf2-4052-ba89-ae48509132b8 req-b69c7072-6037-4757-bb52-529c87712b07 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Neutron deleted interface 9a9ad424-1879-420f-ad8e-960e1ae78d3b; detaching it from the instance and deleting it from the info cache
Aug 15 06:58:49 user nova-compute[72803]: DEBUG nova.network.neutron [req-ae5fdf89-edf2-4052-ba89-ae48509132b8 req-b69c7072-6037-4757-bb52-529c87712b07 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [{"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e77e94b-cd4d-40b4-924f-10f67266d802", "address": "fa:16:3e:d5:87:c7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e77e94b-cd", "ovs_interfaceid": "8e77e94b-cd4d-40b4-924f-10f67266d802", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-ae5fdf89-edf2-4052-ba89-ae48509132b8 req-b69c7072-6037-4757-bb52-529c87712b07 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Detach interface failed, port_id=9a9ad424-1879-420f-ad8e-960e1ae78d3b, reason: Instance cec4b0a2-dcfd-418e-af89-d0289651dd0d could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-ae5fdf89-edf2-4052-ba89-ae48509132b8 req-b69c7072-6037-4757-bb52-529c87712b07 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-deleted-8e77e94b-cd4d-40b4-924f-10f67266d802 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:49 user nova-compute[72803]: INFO nova.compute.manager [req-ae5fdf89-edf2-4052-ba89-ae48509132b8 req-b69c7072-6037-4757-bb52-529c87712b07 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Neutron deleted interface 8e77e94b-cd4d-40b4-924f-10f67266d802; detaching it from the instance and deleting it from the info cache
Aug 15 06:58:49 user nova-compute[72803]: DEBUG nova.network.neutron [req-ae5fdf89-edf2-4052-ba89-ae48509132b8 req-b69c7072-6037-4757-bb52-529c87712b07 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [{"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc79d7d-12af-4c59-bb93-571748f8620a", "address": "fa:16:3e:5f:21:a7", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc79d7d-12", "ovs_interfaceid": "cbc79d7d-12af-4c59-bb93-571748f8620a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-ae5fdf89-edf2-4052-ba89-ae48509132b8 req-b69c7072-6037-4757-bb52-529c87712b07 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Detach interface failed, port_id=8e77e94b-cd4d-40b4-924f-10f67266d802, reason: Instance cec4b0a2-dcfd-418e-af89-d0289651dd0d could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23537626265383637', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626265383637', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:58:49 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lazy-loading 'flavor' on Instance uuid 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:50 user nova-compute[72803]: INFO nova.compute.manager [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Terminating instance
Aug 15 06:58:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-48aeadeb-b2f8-48e6-b6c0-562fb2999bf9 req-4c3e7401-9956-4f15-b90f-40c874fc590a service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-48aeadeb-b2f8-48e6-b6c0-562fb2999bf9 req-4c3e7401-9956-4f15-b90f-40c874fc590a service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-48aeadeb-b2f8-48e6-b6c0-562fb2999bf9 req-4c3e7401-9956-4f15-b90f-40c874fc590a service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-48aeadeb-b2f8-48e6-b6c0-562fb2999bf9 req-4c3e7401-9956-4f15-b90f-40c874fc590a service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-48aeadeb-b2f8-48e6-b6c0-562fb2999bf9 req-4c3e7401-9956-4f15-b90f-40c874fc590a service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-unplugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-48aeadeb-b2f8-48e6-b6c0-562fb2999bf9 req-4c3e7401-9956-4f15-b90f-40c874fc590a service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 346030080 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64eef4b-a2d5-4752-93d4-40a24ebbca56 req-23f846f0-dd96-4e9c-83a2-85d97dc95ece service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-deleted-cbc79d7d-12af-4c59-bb93-571748f8620a {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:51 user nova-compute[72803]: INFO nova.compute.manager [req-e64eef4b-a2d5-4752-93d4-40a24ebbca56 req-23f846f0-dd96-4e9c-83a2-85d97dc95ece service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Neutron deleted interface cbc79d7d-12af-4c59-bb93-571748f8620a; detaching it from the instance and deleting it from the info cache
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.network.neutron [req-e64eef4b-a2d5-4752-93d4-40a24ebbca56 req-23f846f0-dd96-4e9c-83a2-85d97dc95ece service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [{"id": "66f37461-2446-4ec8-acaa-a6728062d656", "address": "fa:16:3e:2d:df:48", "network": {"id": "55f3fbac-a266-4911-9685-0cdc83d1d58a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1349280934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f37461-24", "ovs_interfaceid": "66f37461-2446-4ec8-acaa-a6728062d656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 508559360 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64eef4b-a2d5-4752-93d4-40a24ebbca56 req-23f846f0-dd96-4e9c-83a2-85d97dc95ece service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Detach interface failed, port_id=cbc79d7d-12af-4c59-bb93-571748f8620a, reason: Instance cec4b0a2-dcfd-418e-af89-d0289651dd0d could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64eef4b-a2d5-4752-93d4-40a24ebbca56 req-23f846f0-dd96-4e9c-83a2-85d97dc95ece service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-deleted-66f37461-2446-4ec8-acaa-a6728062d656 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:51 user nova-compute[72803]: INFO nova.compute.manager [req-e64eef4b-a2d5-4752-93d4-40a24ebbca56 req-23f846f0-dd96-4e9c-83a2-85d97dc95ece service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Neutron deleted interface 66f37461-2446-4ec8-acaa-a6728062d656; detaching it from the instance and deleting it from the info cache
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.network.neutron [req-e64eef4b-a2d5-4752-93d4-40a24ebbca56 req-23f846f0-dd96-4e9c-83a2-85d97dc95ece service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [{"id": "9890d264-59a1-45c6-ae4e-38d4c247d002", "address": "fa:16:3e:dc:4d:29", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9890d264-59", "ovs_interfaceid": "9890d264-59a1-45c6-ae4e-38d4c247d002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "544213fa-d329-4fdc-932f-e0e66c659e9a", "address": "fa:16:3e:52:72:a2", "network": {"id": "d0a7d005-9336-4427-9b99-555a344e6dae", "bridge": "br-int", "label": "tempest-device-tagging-net1-1598159209", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544213fa-d3", "ovs_interfaceid": "544213fa-d329-4fdc-932f-e0e66c659e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73595875-33de-4f73-a8bd-a939ef40aa34", "address": "fa:16:3e:5a:0a:11", "network": {"id": "0bd50eea-e06d-4376-885a-7c21927f19a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482005", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a4c3886587c54c7281d4da2afb3ddadc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73595875-33", "ovs_interfaceid": "73595875-33de-4f73-a8bd-a939ef40aa34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:51 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Took 6.11 seconds to deallocate network for instance.
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64eef4b-a2d5-4752-93d4-40a24ebbca56 req-23f846f0-dd96-4e9c-83a2-85d97dc95ece service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Detach interface failed, port_id=66f37461-2446-4ec8-acaa-a6728062d656, reason: Instance cec4b0a2-dcfd-418e-af89-d0289651dd0d could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 06:58:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 698351616 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Instance destroyed successfully.
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.objects.instance [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lazy-loading 'resources' on Instance uuid 7d3ab35f-ec73-444d-9cc3-e62213f19918 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:b2:28,bridge_name='br-int',has_traffic_filtering=True,id=7ef268dd-8261-4e19-a09e-f1a5ccb4a036,network=Network(22779c3a-8a44-4d1b-b01e-5cc42a4d48e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef268dd-82') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b2:28,bridge_name='br-int',has_traffic_filtering=True,id=7ef268dd-8261-4e19-a09e-f1a5ccb4a036,network=Network(22779c3a-8a44-4d1b-b01e-5cc42a4d48e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef268dd-82') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ef268dd-82, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: INFO os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b2:28,bridge_name='br-int',has_traffic_filtering=True,id=7ef268dd-8261-4e19-a09e-f1a5ccb4a036,network=Network(22779c3a-8a44-4d1b-b01e-5cc42a4d48e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef268dd-82')
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:28:99,bridge_name='br-int',has_traffic_filtering=True,id=fd631e34-2c3b-471f-8e7e-d9b9b3b414e4,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd631e34-2c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:28:99,bridge_name='br-int',has_traffic_filtering=True,id=fd631e34-2c3b-471f-8e7e-d9b9b3b414e4,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd631e34-2c') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd631e34-2c, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:52 user nova-compute[72803]: WARNING nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 for instance with vm_state active and task_state deleting.
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-unplugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:52 user nova-compute[72803]: WARNING nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-fd631e34-2c3b-471f-8e7e-d9b9b3b414e4 for instance with vm_state active and task_state deleting.
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-unplugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:52 user nova-compute[72803]: WARNING nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-8fbce24c-1507-4aa3-bbb2-37a5d1513bf6 for instance with vm_state active and task_state deleting.
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-unplugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-16270b22-ed84-4555-9d68-9e7b3d504ac2 req-d6cf1dcd-143a-4229-8889-590d3c15f2f0 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: INFO os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:28:99,bridge_name='br-int',has_traffic_filtering=True,id=fd631e34-2c3b-471f-8e7e-d9b9b3b414e4,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd631e34-2c')
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0e:40,bridge_name='br-int',has_traffic_filtering=True,id=8fbce24c-1507-4aa3-bbb2-37a5d1513bf6,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fbce24c-15') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0e:40,bridge_name='br-int',has_traffic_filtering=True,id=8fbce24c-1507-4aa3-bbb2-37a5d1513bf6,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fbce24c-15') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fbce24c-15, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 839909376 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: INFO os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0e:40,bridge_name='br-int',has_traffic_filtering=True,id=8fbce24c-1507-4aa3-bbb2-37a5d1513bf6,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8fbce24c-15')
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:34:7d,bridge_name='br-int',has_traffic_filtering=True,id=bd972609-e9bc-43d8-9c53-629c9a1dba59,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd972609-e9') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:34:7d,bridge_name='br-int',has_traffic_filtering=True,id=bd972609-e9bc-43d8-9c53-629c9a1dba59,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd972609-e9') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd972609-e9, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: INFO os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:34:7d,bridge_name='br-int',has_traffic_filtering=True,id=bd972609-e9bc-43d8-9c53-629c9a1dba59,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd972609-e9')
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:47:fd,bridge_name='br-int',has_traffic_filtering=True,id=31fc1ad3-346b-47a5-b5c9-a34e22ba8c29,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fc1ad3-34') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:47:fd,bridge_name='br-int',has_traffic_filtering=True,id=31fc1ad3-346b-47a5-b5c9-a34e22ba8c29,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fc1ad3-34') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31fc1ad3-34, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: INFO os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:47:fd,bridge_name='br-int',has_traffic_filtering=True,id=31fc1ad3-346b-47a5-b5c9-a34e22ba8c29,network=Network(479dbcf2-2aed-4404-be3c-1296cd8a0105),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31fc1ad3-34')
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "5449c4c2-88f5-492a-9640-c785d926de8b", "address": "fa:16:3e:5a:92:df", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5449c4c2-88", "ovs_interfaceid": "5449c4c2-88f5-492a-9640-c785d926de8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:92:df,bridge_name='br-int',has_traffic_filtering=True,id=5449c4c2-88f5-492a-9640-c785d926de8b,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5449c4c2-88') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:92:df,bridge_name='br-int',has_traffic_filtering=True,id=5449c4c2-88f5-492a-9640-c785d926de8b,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5449c4c2-88') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5449c4c2-88, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: INFO os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:92:df,bridge_name='br-int',has_traffic_filtering=True,id=5449c4c2-88f5-492a-9640-c785d926de8b,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5449c4c2-88')
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1872284105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1872284105',id=11,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7Uc8f0/rJdbIK+SqHDxMAx6eWXx+gwdyQte++Q0lXvvu5PKCZDhIjSyP+2iDmakWbFUn4duSZgX/eU1qcsRem8KVfpv3ol3HK31Aa1iIGA4X+wsf+AZf8T3XDwHajENA==',key_name='tempest-keypair-2112780222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c3be2ca2f3443a2afa55b98f722620d',ramdisk_id='',reservation_id='r-l21n6rp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-380563655',owner_user_name='tempest-TaggedBootDevicesTest_v242-380563655-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='250cd0a9c2534451a8ddd9cd82a91eae',uuid=7d3ab35f-ec73-444d-9cc3-e62213f19918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converting VIF {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:02:49,bridge_name='br-int',has_traffic_filtering=True,id=5c30b612-476a-4410-8a38-81d20e09e021,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c30b612-47') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:02:49,bridge_name='br-int',has_traffic_filtering=True,id=5c30b612-476a-4410-8a38-81d20e09e021,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c30b612-47') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c30b612-47, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:58:53 user nova-compute[72803]: INFO os_vif [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:02:49,bridge_name='br-int',has_traffic_filtering=True,id=5c30b612-476a-4410-8a38-81d20e09e021,network=Network(6569c629-523f-4618-8414-8828e57b4cb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c30b612-47')
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQGCigpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:53 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0651cd1-0ee5-46f3-a802-c43c446a3bbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf9429-9ba8-4020-ae3d-555bd5eebdf0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0779f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282'): ({'sde'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Removing single pathed devices sde {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf19c4-0711-471e-889c-c0e8a89c7bdd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6d67f8-c285-4af3-83a0-d2ea9623e511]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Flushing IO for device /dev/sde {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee6fb8e-367b-46cd-8763-8ab539328b97]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[51302047-51c1-4497-a03b-78397198f6d1]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] SCSI volumes sde have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 988807168 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f066b88-22b2-49e0-8321-44e8f27f1e12]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a80873-a479-417b-b4a9-8e9d02b9e5dc]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282, portal: 172.16.0.220,3260]
Aug 15 06:58:53 user nova-compute[72803]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df43cefc-ab8e-4217-9f9a-60280056a282 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb358146-8077-494c-ac26-9b94e42813c8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== disconnect_volume: return (417ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GNgeDYmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:53 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f07243-9f55-4ce5-a516-b9f0ccf97455]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d6239c-180a-4c79-b62b-06bd79bdcca1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:53 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05aab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65'): ({'sdf'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Removing single pathed devices sdf {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a52b0-f195-44da-b804-642f3746d316]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9065c160-851c-4bbf-9018-ff9e87c57ba8]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Flushing IO for device /dev/sdf {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-875b1e2e-6fe1-46f7-abe9-934c32604598 req-66b260d4-1acb-4998-95fc-df57ec7d5b91 service nova] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Received event network-vif-deleted-73595875-33de-4f73-a8bd-a939ef40aa34 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf88f4-4e48-43c4-965e-e1cc5932fc2b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1299deb5-2e00-4c48-a6c4-d7a15ac7ccaf]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] SCSI volumes sdf have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[594690a9-41b4-480b-ba0c-42e398362896]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e51f64f-eb4f-408b-a73f-5070ae78ba31]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65, portal: 172.16.0.220,3260]
Aug 15 06:58:53 user nova-compute[72803]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48a11f13-ce2f-4abb-8864-e8b2a19d5a65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc92421e-7e7b-4bca-9156-871583b1a07e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== disconnect_volume: return (356ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUivPTnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:54 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c409e1-e984-43ef-aab9-793ca061c950]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb8bd02-2590-4c08-844e-70044c0a9428]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:54 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:54 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05aab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775'): ({'sdg'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Removing single pathed devices sdg {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fec3d1c-a6fc-4799-9ab0-2a37479d417f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WUfmknub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '41507c5b-b341-4da6-ac3a-003817964f6b'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:54 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1dea5f-4d3b-45b8-83f7-7ca82a9408bc]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Flushing IO for device /dev/sdg {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e629870-cbc2-46f7-ad26-82f707ada6f6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa74e85-3329-4f21-b816-a0bab2f72af9]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] SCSI volumes sdg have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[366c1686-2cdb-4417-8919-cf7af7410e72]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3798b9-9257-4735-80c1-7812618032d2]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775, portal: 172.16.0.220,3260]
Aug 15 06:58:54 user nova-compute[72803]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:54 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e5a6aa-1301-42fd-b80f-a32376121775 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee6a1b8-95ad-4699-b42c-58a364213a54]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] <== disconnect_volume: return (289ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:54 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Deleting instance files /opt/stack/data/nova/instances/7d3ab35f-ec73-444d-9cc3-e62213f19918_del
Aug 15 06:58:54 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Deletion of /opt/stack/data/nova/instances/7d3ab35f-ec73-444d-9cc3-e62213f19918_del complete
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.203s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe62250d-8b78-4c21-83b1-9e108aa67801]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4358852a-4b6a-4634-8e60-1c665f653342]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:54 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:54 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:54 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e011c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b'): ({'sdj'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Removing single pathed devices sdj {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: INFO nova.compute.manager [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Took 4.12 seconds to destroy the instance on the hypervisor.
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88f4f08-6b8c-4eab-8142-c6ff92707a9e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[15234576-33d9-4c57-9619-c4c8b345f80f]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Flushing IO for device /dev/sdj {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c89c3-c230-48e3-a6a2-5f0d4125bf2e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f690ac45-0065-48ea-8ca6-7cedad880f52]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] SCSI volumes sdj have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283653f-d279-4a03-bf74-b94839ca25f1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b11d59c-0b43-42c1-85f3-9288bdf1e377]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b, portal: 172.16.0.220,3260]
Aug 15 06:58:54 user nova-compute[72803]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:54 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41507c5b-b341-4da6-ac3a-003817964f6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f3efdd-9ae4-4fac-a2ca-44721d404ecf]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] <== disconnect_volume: return (490ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0cb66e88-04aa-47cb-b403-16e16704a9f9', 'attached_at': '', 'detached_at': '', 'volume_id': '547af602-6fdf-4a6b-b82e-af811864f6b5', 'serial'} {{(pid=72803) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] swap_volume: removing Cinder connection for volume 41507c5b-b341-4da6-ac3a-003817964f6b {{(pid=72803) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:54 user nova-compute[72803]: WARNING nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-bd972609-e9bc-43d8-9c53-629c9a1dba59 for instance with vm_state active and task_state deleting.
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-unplugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:54 user nova-compute[72803]: WARNING nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 for instance with vm_state active and task_state deleting.
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-unplugged-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-5449c4c2-88f5-492a-9640-c785d926de8b for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:54 user nova-compute[72803]: WARNING nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-5449c4c2-88f5-492a-9640-c785d926de8b for instance with vm_state active and task_state deleting.
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-unplugged-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-unplugged-5c30b612-476a-4410-8a38-81d20e09e021 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Acquiring lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] No waiting events found dispatching network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:58:54 user nova-compute[72803]: WARNING nova.compute.manager [req-e64167b1-39fc-49bd-9b26-58765925a366 req-ba96b019-fd34-4adb-9e7e-6bf6941f8353 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received unexpected event network-vif-plugged-5c30b612-476a-4410-8a38-81d20e09e021 for instance with vm_state active and task_state deleting.
Aug 15 06:58:55 user nova-compute[72803]: INFO nova.compute.manager [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Took 3.23 seconds to detach 3 volumes for instance.
Aug 15 06:58:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:55 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:58:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:58:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] swap_volume: Updating volume 41507c5b-b341-4da6-ac3a-003817964f6b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "CMolYfGq", "auth_password": "Gceh38O7Cd4lXq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "547af602-6fdf-4a6b-b82e-af811864f6b5"}, "status": "reserved", "instance": "0cb66e88-04aa-47cb-b403-16e16704a9f9", "attached_at": "", "detached_at": "", "volume_id": "547af602-6fdf-4a6b-b82e-af811864f6b5", "serial": "547af602-6fdf-4a6b-b82e-af811864f6b5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '547af602-6fdf-4a6b-b82e-af811864f6b5', 'no_device': None, 'attachment_id': '5571928d-4271-49b3-9928-0bcc83675a92'} {{(pid=72803) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 06:58:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c5f268ec-d6b8-4c1a-8e15-866631897675 tempest-TestVolumeSwap-1235249105 tempest-TestVolumeSwap-1235249105-project-admin] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.914s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:55 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Deleted allocations for instance cec4b0a2-dcfd-418e-af89-d0289651dd0d
Aug 15 06:58:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42cebf5d-a0cb-495d-a6cb-b4a4fa185b4f tempest-TaggedBootDevicesTest-935268704 tempest-TaggedBootDevicesTest-935268704-project-member] Lock "cec4b0a2-dcfd-418e-af89-d0289651dd0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.043s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-69327aaa-032e-4649-8a90-bc0aa501452d req-e4cd50ca-2cd0-4c6d-bfa7-602b57e77d37 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-deleted-5449c4c2-88f5-492a-9640-c785d926de8b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:56 user nova-compute[72803]: INFO nova.compute.manager [req-69327aaa-032e-4649-8a90-bc0aa501452d req-e4cd50ca-2cd0-4c6d-bfa7-602b57e77d37 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Neutron deleted interface 5449c4c2-88f5-492a-9640-c785d926de8b; detaching it from the instance and deleting it from the info cache
Aug 15 06:58:56 user nova-compute[72803]: DEBUG nova.network.neutron [req-69327aaa-032e-4649-8a90-bc0aa501452d req-e4cd50ca-2cd0-4c6d-bfa7-602b57e77d37 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [{"id": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "address": "fa:16:3e:08:b2:28", "network": {"id": "22779c3a-8a44-4d1b-b01e-5cc42a4d48e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-85022265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef268dd-82", "ovs_interfaceid": "7ef268dd-8261-4e19-a09e-f1a5ccb4a036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "address": "fa:16:3e:95:28:99", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd631e34-2c", "ovs_interfaceid": "fd631e34-2c3b-471f-8e7e-d9b9b3b414e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "address": "fa:16:3e:1f:0e:40", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbce24c-15", "ovs_interfaceid": "8fbce24c-1507-4aa3-bbb2-37a5d1513bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "address": "fa:16:3e:d6:34:7d", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd972609-e9", "ovs_interfaceid": "bd972609-e9bc-43d8-9c53-629c9a1dba59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "address": "fa:16:3e:aa:47:fd", "network": {"id": "479dbcf2-2aed-4404-be3c-1296cd8a0105", "bridge": "br-int", "label": "tempest-device-tagging-net1-1326426841", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31fc1ad3-34", "ovs_interfaceid": "31fc1ad3-346b-47a5-b5c9-a34e22ba8c29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c30b612-476a-4410-8a38-81d20e09e021", "address": "fa:16:3e:cc:02:49", "network": {"id": "6569c629-523f-4618-8414-8828e57b4cb6", "bridge": "br-int", "label": "tempest-device-tagging-net2-417304490", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c3be2ca2f3443a2afa55b98f722620d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c30b612-47", "ovs_interfaceid": "5c30b612-476a-4410-8a38-81d20e09e021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-69327aaa-032e-4649-8a90-bc0aa501452d req-e4cd50ca-2cd0-4c6d-bfa7-602b57e77d37 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Detach interface failed, port_id=5449c4c2-88f5-492a-9640-c785d926de8b, reason: Instance 7d3ab35f-ec73-444d-9cc3-e62213f19918 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 06:58:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:58:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:58:56 user nova-compute[72803]: INFO nova.compute.manager [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Detaching volume 547af602-6fdf-4a6b-b82e-af811864f6b5
Aug 15 06:58:56 user nova-compute[72803]: INFO nova.virt.block_device [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Attempting to driver detach volume 547af602-6fdf-4a6b-b82e-af811864f6b5 from mountpoint /dev/vdb
Aug 15 06:58:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Attempting to detach device vdb from instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:58:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:58:56 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:56 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 06:58:56 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:56 user nova-compute[72803]:   <serial>547af602-6fdf-4a6b-b82e-af811864f6b5</serial>
Aug 15 06:58:56 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:58:56 user nova-compute[72803]: </disk>
Aug 15 06:58:56 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:58:56 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Successfully detached device vdb from instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 from the persistent domain config.
Aug 15 06:58:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:58:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:58:56 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:58:56 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 06:58:56 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:58:56 user nova-compute[72803]:   <serial>547af602-6fdf-4a6b-b82e-af811864f6b5</serial>
Aug 15 06:58:56 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:58:56 user nova-compute[72803]: </disk>
Aug 15 06:58:56 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692082737.0656378, 0cb66e88-04aa-47cb-b403-16e16704a9f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:58:57 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Successfully detached device vdb from instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 from the live domain config.
Aug 15 06:58:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMolYfGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '547af602-6fdf-4a6b-b82e-af811864f6b5'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:58:57 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd9dd0-04b4-46dd-bd5d-a9e67466219b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afc4993-a3ce-4733-8eac-40111a7a4566]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:57 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:57 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:57 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:58:57 user nova-compute[72803]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 (non-flash)
Aug 15 06:58:57 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:58:57 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3503ffb5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb209e3a-5b8d-481e-8c5b-b0dd0c9552d1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[466c85bb-9300-416f-8a56-c76b46cc257f]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbbb579-c38d-4714-ac59-6905c4e1bee2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df85d2d-b8e6-4b3b-aa58-77a23a949789]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4650924-c168-4b85-9781-8f7cee6f4337]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[95efd340-f4a6-4a90-9a6a-121ca8310062]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260]
Aug 15 06:58:57 user nova-compute[72803]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5, portal: 172.16.0.220,3260] successful.
Aug 15 06:58:57 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:547af602-6fdf-4a6b-b82e-af811864f6b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65095cef-1519-4e34-8b13-1a2806e2e124]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] <== disconnect_volume: return (276ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:58:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:58:58 user nova-compute[72803]: DEBUG nova.objects.instance [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lazy-loading 'flavor' on Instance uuid 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:58:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:58:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-151908c2-f42d-4dc4-b1a6-ce1176971551 tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.717s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:58:58 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:58:58 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Took 3.87 seconds to deallocate network for instance.
Aug 15 06:58:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-3d9b158e-47ed-49c7-a6f9-51ad376e4c5f req-5be29964-7ff6-41da-8b29-894d606ff9c4 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-deleted-7ef268dd-8261-4e19-a09e-f1a5ccb4a036 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-3d9b158e-47ed-49c7-a6f9-51ad376e4c5f req-5be29964-7ff6-41da-8b29-894d606ff9c4 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-deleted-bd972609-e9bc-43d8-9c53-629c9a1dba59 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-3d9b158e-47ed-49c7-a6f9-51ad376e4c5f req-5be29964-7ff6-41da-8b29-894d606ff9c4 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-deleted-31fc1ad3-346b-47a5-b5c9-a34e22ba8c29 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-3d9b158e-47ed-49c7-a6f9-51ad376e4c5f req-5be29964-7ff6-41da-8b29-894d606ff9c4 service nova] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Received event network-vif-deleted-5c30b612-476a-4410-8a38-81d20e09e021 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:58:59 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082724.2964334, cec4b0a2-dcfd-418e-af89-d0289651dd0d => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:58:59 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] VM Stopped (Lifecycle Event)
Aug 15 06:58:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-531a150c-a0b3-4a85-9144-d009f3b34046 None None] [instance: cec4b0a2-dcfd-418e-af89-d0289651dd0d] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:00 user nova-compute[72803]: INFO nova.compute.manager [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Took 2.24 seconds to detach 3 volumes for instance.
Aug 15 06:59:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:00 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:00 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:00 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Deleted allocations for instance 7d3ab35f-ec73-444d-9cc3-e62213f19918
Aug 15 06:59:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-461ca6d4-0373-4b24-b932-2aa030e47139 tempest-TaggedBootDevicesTest_v242-380563655 tempest-TaggedBootDevicesTest_v242-380563655-project-member] Lock "7d3ab35f-ec73-444d-9cc3-e62213f19918" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.756s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:59:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:59:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:59:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:59:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "d3ad37b6-a585-4e6f-8164-3b726b486412" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:59:06 user nova-compute[72803]: INFO nova.compute.claims [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Claim successful on node user
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:59:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:59:06 user nova-compute[72803]: DEBUG nova.policy [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e992a5e7525e41249ddd5e6fbf1cd24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1922e1157f794f3e8eee8df93e0a6276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:59:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Creating image(s)
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "/opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "/opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.232s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.256s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082732.5614436, 7d3ab35f-ec73-444d-9cc3-e62213f19918 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:07 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] VM Stopped (Lifecycle Event)
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk 1073741824" returned: 0 in 0.062s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-23b702e7-bb0b-4efa-981e-3beba979869c None None] [instance: 7d3ab35f-ec73-444d-9cc3-e62213f19918] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Successfully created port: 91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.273s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:59:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Cannot resize image /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.objects.instance [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'migration_context' on Instance uuid d3ad37b6-a585-4e6f-8164-3b726b486412 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Ensure instance console log exists: /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Successfully updated port: 91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "refresh_cache-d3ad37b6-a585-4e6f-8164-3b726b486412" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquired lock "refresh_cache-d3ad37b6-a585-4e6f-8164-3b726b486412" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-dd11cb17-664b-4d4a-bd88-9bf5e6cd4891 req-000667b7-c6ec-4272-97c7-f61ff6f46eb2 service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received event network-changed-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-dd11cb17-664b-4d4a-bd88-9bf5e6cd4891 req-000667b7-c6ec-4272-97c7-f61ff6f46eb2 service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Refreshing instance network info cache due to event network-changed-91bf85aa-da25-4b11-b362-487fb905c425. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-dd11cb17-664b-4d4a-bd88-9bf5e6cd4891 req-000667b7-c6ec-4272-97c7-f61ff6f46eb2 service nova] Acquiring lock "refresh_cache-d3ad37b6-a585-4e6f-8164-3b726b486412" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Updating instance_info_cache with network_info: [{"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Releasing lock "refresh_cache-d3ad37b6-a585-4e6f-8164-3b726b486412" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Instance network_info: |[{"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-dd11cb17-664b-4d4a-bd88-9bf5e6cd4891 req-000667b7-c6ec-4272-97c7-f61ff6f46eb2 service nova] Acquired lock "refresh_cache-d3ad37b6-a585-4e6f-8164-3b726b486412" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-dd11cb17-664b-4d4a-bd88-9bf5e6cd4891 req-000667b7-c6ec-4272-97c7-f61ff6f46eb2 service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Refreshing network info cache for port 91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Start _get_guest_xml network_info=[{"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:59:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-738900610',display_name='tempest-VolumesAdminNegativeTest-server-738900610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-738900610',id=15,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1922e1157f794f3e8eee8df93e0a6276',ramdisk_id='',reservation_id='r-05maoiaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1805149867',owner_user_name='tempest-VolumesAdminNegativeTest-1805149867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:59:07Z,user_data=None,user_id='e992a5e7525e41249ddd5e6fbf1cd24c',uuid=d3ad37b6-a585-4e6f-8164-3b726b486412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converting VIF {"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:96,bridge_name='br-int',has_traffic_filtering=True,id=91bf85aa-da25-4b11-b362-487fb905c425,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bf85aa-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'pci_devices' on Instance uuid d3ad37b6-a585-4e6f-8164-3b726b486412 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:59:09 user nova-compute[72803]:   <uuid>d3ad37b6-a585-4e6f-8164-3b726b486412</uuid>
Aug 15 06:59:09 user nova-compute[72803]:   <name>instance-0000000f</name>
Aug 15 06:59:09 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:59:09 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:59:09 user nova-compute[72803]:   <metadata>
Aug 15 06:59:09 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:59:09 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:59:09 user nova-compute[72803]:       <nova:name>tempest-VolumesAdminNegativeTest-server-738900610</nova:name>
Aug 15 06:59:09 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:59:09</nova:creationTime>
Aug 15 06:59:09 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:59:09 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:59:09 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:59:09 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:59:09 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:59:09 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:59:09 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:59:09 user nova-compute[72803]:       <nova:owner>
Aug 15 06:59:09 user nova-compute[72803]:         <nova:user uuid="e992a5e7525e41249ddd5e6fbf1cd24c">tempest-VolumesAdminNegativeTest-1805149867-project-member</nova:user>
Aug 15 06:59:09 user nova-compute[72803]:         <nova:project uuid="1922e1157f794f3e8eee8df93e0a6276">tempest-VolumesAdminNegativeTest-1805149867</nova:project>
Aug 15 06:59:09 user nova-compute[72803]:       </nova:owner>
Aug 15 06:59:09 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:59:09 user nova-compute[72803]:       <nova:ports>
Aug 15 06:59:09 user nova-compute[72803]:         <nova:port uuid="91bf85aa-da25-4b11-b362-487fb905c425">
Aug 15 06:59:09 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 06:59:09 user nova-compute[72803]:         </nova:port>
Aug 15 06:59:09 user nova-compute[72803]:       </nova:ports>
Aug 15 06:59:09 user nova-compute[72803]:     </nova:instance>
Aug 15 06:59:09 user nova-compute[72803]:   </metadata>
Aug 15 06:59:09 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:59:09 user nova-compute[72803]:     <system>
Aug 15 06:59:09 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:59:09 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:59:09 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:59:09 user nova-compute[72803]:       <entry name="serial">d3ad37b6-a585-4e6f-8164-3b726b486412</entry>
Aug 15 06:59:09 user nova-compute[72803]:       <entry name="uuid">d3ad37b6-a585-4e6f-8164-3b726b486412</entry>
Aug 15 06:59:09 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:59:09 user nova-compute[72803]:     </system>
Aug 15 06:59:09 user nova-compute[72803]:   </sysinfo>
Aug 15 06:59:09 user nova-compute[72803]:   <os>
Aug 15 06:59:09 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:59:09 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:59:09 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:59:09 user nova-compute[72803]:   </os>
Aug 15 06:59:09 user nova-compute[72803]:   <features>
Aug 15 06:59:09 user nova-compute[72803]:     <acpi/>
Aug 15 06:59:09 user nova-compute[72803]:     <apic/>
Aug 15 06:59:09 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:59:09 user nova-compute[72803]:   </features>
Aug 15 06:59:09 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:59:09 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:59:09 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:59:09 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:59:09 user nova-compute[72803]:   </clock>
Aug 15 06:59:09 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:59:09 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:59:09 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:59:09 user nova-compute[72803]:   </cpu>
Aug 15 06:59:09 user nova-compute[72803]:   <devices>
Aug 15 06:59:09 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:59:09 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:59:09 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk"/>
Aug 15 06:59:09 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:59:09 user nova-compute[72803]:     </disk>
Aug 15 06:59:09 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:59:09 user nova-compute[72803]:       <mac address="fa:16:3e:10:1c:96"/>
Aug 15 06:59:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:59:09 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:59:09 user nova-compute[72803]:       <target dev="tap91bf85aa-da"/>
Aug 15 06:59:09 user nova-compute[72803]:     </interface>
Aug 15 06:59:09 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:59:09 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/console.log" append="off"/>
Aug 15 06:59:09 user nova-compute[72803]:     </serial>
Aug 15 06:59:09 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:59:09 user nova-compute[72803]:     <video>
Aug 15 06:59:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:59:09 user nova-compute[72803]:     </video>
Aug 15 06:59:09 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:59:09 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:59:09 user nova-compute[72803]:     </rng>
Aug 15 06:59:09 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:59:09 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:59:09 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:59:09 user nova-compute[72803]:     </memballoon>
Aug 15 06:59:09 user nova-compute[72803]:   </devices>
Aug 15 06:59:09 user nova-compute[72803]: </domain>
Aug 15 06:59:09 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-738900610',display_name='tempest-VolumesAdminNegativeTest-server-738900610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-738900610',id=15,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1922e1157f794f3e8eee8df93e0a6276',ramdisk_id='',reservation_id='r-05maoiaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1805149867',owner_user_name='tempest-VolumesAdminNegativeTest-1805149867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:59:07Z,user_data=None,user_id='e992a5e7525e41249ddd5e6fbf1cd24c',uuid=d3ad37b6-a585-4e6f-8164-3b726b486412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converting VIF {"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:96,bridge_name='br-int',has_traffic_filtering=True,id=91bf85aa-da25-4b11-b362-487fb905c425,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bf85aa-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG os_vif [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:96,bridge_name='br-int',has_traffic_filtering=True,id=91bf85aa-da25-4b11-b362-487fb905c425,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bf85aa-da') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91bf85aa-da, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91bf85aa-da, col_values=(('external_ids', {'iface-id': '91bf85aa-da25-4b11-b362-487fb905c425', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:1c:96', 'vm-uuid': 'd3ad37b6-a585-4e6f-8164-3b726b486412'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:09 user nova-compute[72803]: INFO os_vif [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:96,bridge_name='br-int',has_traffic_filtering=True,id=91bf85aa-da25-4b11-b362-487fb905c425,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bf85aa-da')
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] No VIF found with MAC fa:16:3e:10:1c:96, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-dd11cb17-664b-4d4a-bd88-9bf5e6cd4891 req-000667b7-c6ec-4272-97c7-f61ff6f46eb2 service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Updated VIF entry in instance network info cache for port 91bf85aa-da25-4b11-b362-487fb905c425. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-dd11cb17-664b-4d4a-bd88-9bf5e6cd4891 req-000667b7-c6ec-4272-97c7-f61ff6f46eb2 service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Updating instance_info_cache with network_info: [{"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-dd11cb17-664b-4d4a-bd88-9bf5e6cd4891 req-000667b7-c6ec-4272-97c7-f61ff6f46eb2 service nova] Releasing lock "refresh_cache-d3ad37b6-a585-4e6f-8164-3b726b486412" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:09 user nova-compute[72803]: INFO nova.compute.manager [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Terminating instance
Aug 15 06:59:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:59:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-91d9f900-4191-4b8e-8294-b16dc5b007f5 req-af7ac084-b960-4717-85e6-29e631374959 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received event network-vif-unplugged-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-91d9f900-4191-4b8e-8294-b16dc5b007f5 req-af7ac084-b960-4717-85e6-29e631374959 service nova] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-91d9f900-4191-4b8e-8294-b16dc5b007f5 req-af7ac084-b960-4717-85e6-29e631374959 service nova] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-91d9f900-4191-4b8e-8294-b16dc5b007f5 req-af7ac084-b960-4717-85e6-29e631374959 service nova] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-91d9f900-4191-4b8e-8294-b16dc5b007f5 req-af7ac084-b960-4717-85e6-29e631374959 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] No waiting events found dispatching network-vif-unplugged-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-91d9f900-4191-4b8e-8294-b16dc5b007f5 req-af7ac084-b960-4717-85e6-29e631374959 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received event network-vif-unplugged-cc67af0c-51e8-43bf-885f-302f61325c66 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:59:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Instance destroyed successfully.
Aug 15 06:59:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lazy-loading 'resources' on Instance uuid c94b60f1-bfc1-488a-9c12-255a15a29002 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2009508264',display_name='tempest-VolumesAssistedSnapshotsTest-server-2009508264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2009508264',id=6,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVNUcOonDkvpFXkVZq76qUr4fSeKJwk7UVusTTBkW/vHM1iHJtI/Vmsk2RbyaSVOkqQex3ETyNU4resqWo593BddCSfCgujuCBHcnDzUCCPBW6+SsSktHWnNzbPqmp/wA==',key_name='tempest-keypair-2029539496',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afaab00278854c85a4d50c6eed9ad176',ramdisk_id='',reservation_id='r-w0uffamp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1594388956',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1594388956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3fa5c5df3de4b589614d1ca9ab059ad',uuid=c94b60f1-bfc1-488a-9c12-255a15a29002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Converting VIF {"id": "cc67af0c-51e8-43bf-885f-302f61325c66", "address": "fa:16:3e:ec:68:65", "network": {"id": "daa8ce77-7150-4fa2-b620-b9fe46d72bf3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-344434840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afaab00278854c85a4d50c6eed9ad176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc67af0c-51", "ovs_interfaceid": "cc67af0c-51e8-43bf-885f-302f61325c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:68:65,bridge_name='br-int',has_traffic_filtering=True,id=cc67af0c-51e8-43bf-885f-302f61325c66,network=Network(daa8ce77-7150-4fa2-b620-b9fe46d72bf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc67af0c-51') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG os_vif [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:68:65,bridge_name='br-int',has_traffic_filtering=True,id=cc67af0c-51e8-43bf-885f-302f61325c66,network=Network(daa8ce77-7150-4fa2-b620-b9fe46d72bf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc67af0c-51') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc67af0c-51, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: INFO os_vif [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:68:65,bridge_name='br-int',has_traffic_filtering=True,id=cc67af0c-51e8-43bf-885f-302f61325c66,network=Network(daa8ce77-7150-4fa2-b620-b9fe46d72bf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc67af0c-51')
Aug 15 06:59:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Deleting instance files /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002_del
Aug 15 06:59:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Deletion of /opt/stack/data/nova/instances/c94b60f1-bfc1-488a-9c12-255a15a29002_del complete
Aug 15 06:59:11 user nova-compute[72803]: INFO nova.compute.manager [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 15 06:59:11 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-549a3b5b-cb63-44d5-aae6-4ab30ffc4673 req-f53b79c8-fe1c-4e4e-a778-78ebcb96b9f6 service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received event network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-549a3b5b-cb63-44d5-aae6-4ab30ffc4673 req-f53b79c8-fe1c-4e4e-a778-78ebcb96b9f6 service nova] Acquiring lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-549a3b5b-cb63-44d5-aae6-4ab30ffc4673 req-f53b79c8-fe1c-4e4e-a778-78ebcb96b9f6 service nova] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-549a3b5b-cb63-44d5-aae6-4ab30ffc4673 req-f53b79c8-fe1c-4e4e-a778-78ebcb96b9f6 service nova] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-549a3b5b-cb63-44d5-aae6-4ab30ffc4673 req-f53b79c8-fe1c-4e4e-a778-78ebcb96b9f6 service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] No waiting events found dispatching network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:11 user nova-compute[72803]: WARNING nova.compute.manager [req-549a3b5b-cb63-44d5-aae6-4ab30ffc4673 req-f53b79c8-fe1c-4e4e-a778-78ebcb96b9f6 service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received unexpected event network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 for instance with vm_state building and task_state spawning.
Aug 15 06:59:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-069ccd49-41d5-40be-b88c-f15c595595e0 req-3e4ae22c-8ce8-4dd9-9d2c-94970c0e2344 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received event network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-069ccd49-41d5-40be-b88c-f15c595595e0 req-3e4ae22c-8ce8-4dd9-9d2c-94970c0e2344 service nova] Acquiring lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-069ccd49-41d5-40be-b88c-f15c595595e0 req-3e4ae22c-8ce8-4dd9-9d2c-94970c0e2344 service nova] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-069ccd49-41d5-40be-b88c-f15c595595e0 req-3e4ae22c-8ce8-4dd9-9d2c-94970c0e2344 service nova] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-069ccd49-41d5-40be-b88c-f15c595595e0 req-3e4ae22c-8ce8-4dd9-9d2c-94970c0e2344 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] No waiting events found dispatching network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:12 user nova-compute[72803]: WARNING nova.compute.manager [req-069ccd49-41d5-40be-b88c-f15c595595e0 req-3e4ae22c-8ce8-4dd9-9d2c-94970c0e2344 service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received unexpected event network-vif-plugged-cc67af0c-51e8-43bf-885f-302f61325c66 for instance with vm_state active and task_state deleting.
Aug 15 06:59:12 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:12 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Took 1.42 seconds to deallocate network for instance.
Aug 15 06:59:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:13 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Deleted allocations for instance c94b60f1-bfc1-488a-9c12-255a15a29002
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082753.1840775, d3ad37b6-a585-4e6f-8164-3b726b486412 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] VM Resumed (Lifecycle Event)
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5fe67c7b-b7b6-4f84-aab8-7f73c18c92b5 tempest-VolumesAssistedSnapshotsTest-1594388956 tempest-VolumesAssistedSnapshotsTest-1594388956-project-member] Lock "c94b60f1-bfc1-488a-9c12-255a15a29002" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.314s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Instance spawned successfully.
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082753.1862128, d3ad37b6-a585-4e6f-8164-3b726b486412 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] VM Started (Lifecycle Event)
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:59:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:59:13 user nova-compute[72803]: INFO nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-67dbc04b-619a-4229-abe6-f6b0925abbe7 req-68a2c2b8-f9fb-4ba6-9974-ca5f4cfe71ae service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received event network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-67dbc04b-619a-4229-abe6-f6b0925abbe7 req-68a2c2b8-f9fb-4ba6-9974-ca5f4cfe71ae service nova] Acquiring lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-67dbc04b-619a-4229-abe6-f6b0925abbe7 req-68a2c2b8-f9fb-4ba6-9974-ca5f4cfe71ae service nova] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-67dbc04b-619a-4229-abe6-f6b0925abbe7 req-68a2c2b8-f9fb-4ba6-9974-ca5f4cfe71ae service nova] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-67dbc04b-619a-4229-abe6-f6b0925abbe7 req-68a2c2b8-f9fb-4ba6-9974-ca5f4cfe71ae service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] No waiting events found dispatching network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:13 user nova-compute[72803]: WARNING nova.compute.manager [req-67dbc04b-619a-4229-abe6-f6b0925abbe7 req-68a2c2b8-f9fb-4ba6-9974-ca5f4cfe71ae service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received unexpected event network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 for instance with vm_state building and task_state spawning.
Aug 15 06:59:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-67dbc04b-619a-4229-abe6-f6b0925abbe7 req-68a2c2b8-f9fb-4ba6-9974-ca5f4cfe71ae service nova] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Received event network-vif-deleted-cc67af0c-51e8-43bf-885f-302f61325c66 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:13 user nova-compute[72803]: INFO nova.compute.manager [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Took 7.12 seconds to build instance.
Aug 15 06:59:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-eceb516d-0ecb-4d6d-9b72-c2da415368b0 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.228s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:16 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:25 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082750.9779263, c94b60f1-bfc1-488a-9c12-255a15a29002 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:25 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] VM Stopped (Lifecycle Event)
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-dc239b18-f20b-4fb2-a2df-a7e1dce70ad9 None None] [instance: c94b60f1-bfc1-488a-9c12-255a15a29002] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:59:26 user nova-compute[72803]: INFO nova.compute.claims [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Claim successful on node user
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:59:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:59:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Creating image(s)
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:26 user nova-compute[72803]: DEBUG nova.policy [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1e4fd69d1a64b8d80b0d1a45d62190f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaf763674bc4aaca9e52eda0cf41f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-4942d549-d57c-4fde-b1e5-7e2bf0c51509 req-832a5267-37ef-42d0-bf4c-af86503f97a0 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received event network-changed-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-4942d549-d57c-4fde-b1e5-7e2bf0c51509 req-832a5267-37ef-42d0-bf4c-af86503f97a0 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Refreshing instance network info cache due to event network-changed-20ffd8c7-29f1-458c-b57b-fdf407ba0446. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4942d549-d57c-4fde-b1e5-7e2bf0c51509 req-832a5267-37ef-42d0-bf4c-af86503f97a0 service nova] Acquiring lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4942d549-d57c-4fde-b1e5-7e2bf0c51509 req-832a5267-37ef-42d0-bf4c-af86503f97a0 service nova] Acquired lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.network.neutron [req-4942d549-d57c-4fde-b1e5-7e2bf0c51509 req-832a5267-37ef-42d0-bf4c-af86503f97a0 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Refreshing network info cache for port 20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.205s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk 1073741824" returned: 0 in 0.056s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.196s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Cannot resize image /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.objects.instance [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'migration_context' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Ensure instance console log exists: /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG nova.network.neutron [req-4942d549-d57c-4fde-b1e5-7e2bf0c51509 req-832a5267-37ef-42d0-bf4c-af86503f97a0 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Updated VIF entry in instance network info cache for port 20ffd8c7-29f1-458c-b57b-fdf407ba0446. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG nova.network.neutron [req-4942d549-d57c-4fde-b1e5-7e2bf0c51509 req-832a5267-37ef-42d0-bf4c-af86503f97a0 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Updating instance_info_cache with network_info: [{"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Successfully created port: b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4942d549-d57c-4fde-b1e5-7e2bf0c51509 req-832a5267-37ef-42d0-bf4c-af86503f97a0 service nova] Releasing lock "refresh_cache-5fb89ce0-1cc3-4a6a-b812-c889f302584e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:28 user nova-compute[72803]: INFO nova.compute.manager [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Unshelving
Aug 15 06:59:28 user nova-compute[72803]: INFO nova.virt.block_device [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Booting with volume c5491415-5196-4845-b334-b4b31baadcac at /dev/vdc
Aug 15 06:59:28 user nova-compute[72803]: DEBUG os_brick.utils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b6c635-c691-469a-af65-6873cb2b7f30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7879df3c-3ae3-40d3-b2f6-12e06f3646ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9440cb-c224-4f83-997f-296f9d4a8f97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7521572-f1fd-4bf1-91dd-6168f6133ca2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:59:28 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:59:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca901d2d-c99f-44f5-b3b5-3e66798b6e6e]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG os_brick.utils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:59:28 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating existing volume attachment record: ff4cc9b3-72bf-42ce-969c-91d9146b9ef9 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Successfully updated port: b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquired lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-0c9b56d7-af90-44a4-9b12-690d2b8a7d67 req-bbee2c15-1e1f-4ece-8d6b-752a4b2ec1cb service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-changed-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-0c9b56d7-af90-44a4-9b12-690d2b8a7d67 req-bbee2c15-1e1f-4ece-8d6b-752a4b2ec1cb service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Refreshing instance network info cache due to event network-changed-b3c670dd-02a1-4d2c-867a-450884798f63. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0c9b56d7-af90-44a4-9b12-690d2b8a7d67 req-bbee2c15-1e1f-4ece-8d6b-752a4b2ec1cb service nova] Acquiring lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Updating instance_info_cache with network_info: [{"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Releasing lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance network_info: |[{"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0c9b56d7-af90-44a4-9b12-690d2b8a7d67 req-bbee2c15-1e1f-4ece-8d6b-752a4b2ec1cb service nova] Acquired lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.neutron [req-0c9b56d7-af90-44a4-9b12-690d2b8a7d67 req-bbee2c15-1e1f-4ece-8d6b-752a4b2ec1cb service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Refreshing network info cache for port b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Start _get_guest_xml network_info=[{"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:59:29 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:29 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-434501159',display_name='tempest-tempest.common.compute-instance-434501159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-434501159',id=16,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUZ/EwNsA5ruMIw3IDFFAGkJQBK1O6/57tM7BxohUJ7SYDtPC3cHhbHxvpQ+BwkgtdivuuuprwjP+NluswpG70oDt4GOKuJikiDEf0XWiaJ8X18OMWn/ICQApxHaZ4GAQ==',key_name='tempest-keypair-2020809915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-9c6fhw9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=06a22c66-fe35-4c52-aef9-9801f38d2832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.objects.instance [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'pci_devices' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:59:29 user nova-compute[72803]:   <uuid>06a22c66-fe35-4c52-aef9-9801f38d2832</uuid>
Aug 15 06:59:29 user nova-compute[72803]:   <name>instance-00000010</name>
Aug 15 06:59:29 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:59:29 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:59:29 user nova-compute[72803]:   <metadata>
Aug 15 06:59:29 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:59:29 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:59:29 user nova-compute[72803]:       <nova:name>tempest-tempest.common.compute-instance-434501159</nova:name>
Aug 15 06:59:29 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:59:29</nova:creationTime>
Aug 15 06:59:29 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:59:29 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:59:29 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:59:29 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:59:29 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:59:29 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:59:29 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:59:29 user nova-compute[72803]:       <nova:owner>
Aug 15 06:59:29 user nova-compute[72803]:         <nova:user uuid="f1e4fd69d1a64b8d80b0d1a45d62190f">tempest-ServerActionsTestOtherA-931999183-project-member</nova:user>
Aug 15 06:59:29 user nova-compute[72803]:         <nova:project uuid="ecaf763674bc4aaca9e52eda0cf41f44">tempest-ServerActionsTestOtherA-931999183</nova:project>
Aug 15 06:59:29 user nova-compute[72803]:       </nova:owner>
Aug 15 06:59:29 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:59:29 user nova-compute[72803]:       <nova:ports>
Aug 15 06:59:29 user nova-compute[72803]:         <nova:port uuid="b3c670dd-02a1-4d2c-867a-450884798f63">
Aug 15 06:59:29 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 06:59:29 user nova-compute[72803]:         </nova:port>
Aug 15 06:59:29 user nova-compute[72803]:       </nova:ports>
Aug 15 06:59:29 user nova-compute[72803]:     </nova:instance>
Aug 15 06:59:29 user nova-compute[72803]:   </metadata>
Aug 15 06:59:29 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:59:29 user nova-compute[72803]:     <system>
Aug 15 06:59:29 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:59:29 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:59:29 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:59:29 user nova-compute[72803]:       <entry name="serial">06a22c66-fe35-4c52-aef9-9801f38d2832</entry>
Aug 15 06:59:29 user nova-compute[72803]:       <entry name="uuid">06a22c66-fe35-4c52-aef9-9801f38d2832</entry>
Aug 15 06:59:29 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:59:29 user nova-compute[72803]:     </system>
Aug 15 06:59:29 user nova-compute[72803]:   </sysinfo>
Aug 15 06:59:29 user nova-compute[72803]:   <os>
Aug 15 06:59:29 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:59:29 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:59:29 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:59:29 user nova-compute[72803]:   </os>
Aug 15 06:59:29 user nova-compute[72803]:   <features>
Aug 15 06:59:29 user nova-compute[72803]:     <acpi/>
Aug 15 06:59:29 user nova-compute[72803]:     <apic/>
Aug 15 06:59:29 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:59:29 user nova-compute[72803]:   </features>
Aug 15 06:59:29 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:59:29 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:59:29 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:59:29 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:59:29 user nova-compute[72803]:   </clock>
Aug 15 06:59:29 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:59:29 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:59:29 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:59:29 user nova-compute[72803]:   </cpu>
Aug 15 06:59:29 user nova-compute[72803]:   <devices>
Aug 15 06:59:29 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:59:29 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:59:29 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk"/>
Aug 15 06:59:29 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:59:29 user nova-compute[72803]:     </disk>
Aug 15 06:59:29 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:59:29 user nova-compute[72803]:       <mac address="fa:16:3e:96:fd:20"/>
Aug 15 06:59:29 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:59:29 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:59:29 user nova-compute[72803]:       <target dev="tapb3c670dd-02"/>
Aug 15 06:59:29 user nova-compute[72803]:     </interface>
Aug 15 06:59:29 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:59:29 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/console.log" append="off"/>
Aug 15 06:59:29 user nova-compute[72803]:     </serial>
Aug 15 06:59:29 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:59:29 user nova-compute[72803]:     <video>
Aug 15 06:59:29 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:59:29 user nova-compute[72803]:     </video>
Aug 15 06:59:29 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:59:29 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:59:29 user nova-compute[72803]:     </rng>
Aug 15 06:59:29 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:59:29 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:59:29 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:59:29 user nova-compute[72803]:     </memballoon>
Aug 15 06:59:29 user nova-compute[72803]:   </devices>
Aug 15 06:59:29 user nova-compute[72803]: </domain>
Aug 15 06:59:29 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-434501159',display_name='tempest-tempest.common.compute-instance-434501159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-434501159',id=16,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUZ/EwNsA5ruMIw3IDFFAGkJQBK1O6/57tM7BxohUJ7SYDtPC3cHhbHxvpQ+BwkgtdivuuuprwjP+NluswpG70oDt4GOKuJikiDEf0XWiaJ8X18OMWn/ICQApxHaZ4GAQ==',key_name='tempest-keypair-2020809915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-9c6fhw9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=06a22c66-fe35-4c52-aef9-9801f38d2832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG os_vif [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3c670dd-02, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3c670dd-02, col_values=(('external_ids', {'iface-id': 'b3c670dd-02a1-4d2c-867a-450884798f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:fd:20', 'vm-uuid': '06a22c66-fe35-4c52-aef9-9801f38d2832'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:29 user nova-compute[72803]: INFO os_vif [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02')
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:59:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No VIF found with MAC fa:16:3e:96:fd:20, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:59:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-0c9b56d7-af90-44a4-9b12-690d2b8a7d67 req-bbee2c15-1e1f-4ece-8d6b-752a4b2ec1cb service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Updated VIF entry in instance network info cache for port b3c670dd-02a1-4d2c-867a-450884798f63. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:59:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-0c9b56d7-af90-44a4-9b12-690d2b8a7d67 req-bbee2c15-1e1f-4ece-8d6b-752a4b2ec1cb service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Updating instance_info_cache with network_info: [{"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0c9b56d7-af90-44a4-9b12-690d2b8a7d67 req-bbee2c15-1e1f-4ece-8d6b-752a4b2ec1cb service nova] Releasing lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:30 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:59:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:30 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-46e8e599-f8c2-41da-9672-057d9d9505a3 req-257e1efc-6dad-42c3-bf62-caace5ed71dc service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-46e8e599-f8c2-41da-9672-057d9d9505a3 req-257e1efc-6dad-42c3-bf62-caace5ed71dc service nova] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-46e8e599-f8c2-41da-9672-057d9d9505a3 req-257e1efc-6dad-42c3-bf62-caace5ed71dc service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-46e8e599-f8c2-41da-9672-057d9d9505a3 req-257e1efc-6dad-42c3-bf62-caace5ed71dc service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-46e8e599-f8c2-41da-9672-057d9d9505a3 req-257e1efc-6dad-42c3-bf62-caace5ed71dc service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] No waiting events found dispatching network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:31 user nova-compute[72803]: WARNING nova.compute.manager [req-46e8e599-f8c2-41da-9672-057d9d9505a3 req-257e1efc-6dad-42c3-bf62-caace5ed71dc service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received unexpected event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 for instance with vm_state building and task_state spawning.
Aug 15 06:59:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lazy-loading 'flavor' on Instance uuid 5fb89ce0-1cc3-4a6a-b812-c889f302584e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:33 user nova-compute[72803]: INFO nova.compute.manager [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Attaching volume 77ce958e-1092-40a3-b107-94cca390ea2f to /dev/vdb
Aug 15 06:59:33 user nova-compute[72803]: DEBUG os_brick.utils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20fdee1-cfc7-4ed1-859e-47869257f748]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-5ad0e69c-05c8-4cd9-8541-2b713a63f1b9 req-66d0d4d1-5f56-420b-bbdb-59a3e187f7a4 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ad0e69c-05c8-4cd9-8541-2b713a63f1b9 req-66d0d4d1-5f56-420b-bbdb-59a3e187f7a4 service nova] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ad0e69c-05c8-4cd9-8541-2b713a63f1b9 req-66d0d4d1-5f56-420b-bbdb-59a3e187f7a4 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ad0e69c-05c8-4cd9-8541-2b713a63f1b9 req-66d0d4d1-5f56-420b-bbdb-59a3e187f7a4 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-5ad0e69c-05c8-4cd9-8541-2b713a63f1b9 req-66d0d4d1-5f56-420b-bbdb-59a3e187f7a4 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] No waiting events found dispatching network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:33 user nova-compute[72803]: WARNING nova.compute.manager [req-5ad0e69c-05c8-4cd9-8541-2b713a63f1b9 req-66d0d4d1-5f56-420b-bbdb-59a3e187f7a4 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received unexpected event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 for instance with vm_state building and task_state spawning.
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78774c2-7856-4b7d-a53d-c2e817c4036b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[577125d2-0318-496a-9819-e7c8bebd9edf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082773.417395, 06a22c66-fe35-4c52-aef9-9801f38d2832 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] VM Resumed (Lifecycle Event)
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[273fd924-c666-4b17-b096-34503b1a07f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:33 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance spawned successfully.
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:59:33 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f9aec-d74a-4019-ae3a-d19cefe1d217]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG os_brick.utils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Updating existing volume attachment record: 39f552fe-54e6-49a9-97b2-97ed70fdf76c {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:59:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082773.417683, 06a22c66-fe35-4c52-aef9-9801f38d2832 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] VM Started (Lifecycle Event)
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:59:33 user nova-compute[72803]: INFO nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 15 06:59:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:34 user nova-compute[72803]: INFO nova.compute.manager [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Took 7.81 seconds to build instance.
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82906cec-f1d8-40f1-a3cf-5e6429b3d992 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.996s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:59:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:36 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:59:36 user nova-compute[72803]: INFO nova.compute.claims [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Claim successful on node user
Aug 15 06:59:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7468MB free_disk=25.62939453125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.173s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.114s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:59:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ff252c72-caf0-4c90-b078-6aab5a0b1fab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f015c02e-e530-4ec9-9fac-6efad4535956 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance d543c8cd-83cf-4474-a35d-f3c7b7f08093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance d3ad37b6-a585-4e6f-8164-3b726b486412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 06a22c66-fe35-4c52-aef9-9801f38d2832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.policy [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8dca50ff83a4745ad4c40f641851b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850ba4e0e0154650a7f939f83febd354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 454ea345-aaa5-423b-add3-20a933978eec has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 16812ff4-f16a-483b-8614-6d7a3efc4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:59:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Creating image(s)
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "/opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "/opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "/opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk 1073741824" returned: 0 in 0.055s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:37 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.816s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.203s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Successfully created port: f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Cannot resize image /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lazy-loading 'migration_context' on Instance uuid 16812ff4-f16a-483b-8614-6d7a3efc4725 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Ensure instance console log exists: /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Successfully updated port: f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "refresh_cache-16812ff4-f16a-483b-8614-6d7a3efc4725" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquired lock "refresh_cache-16812ff4-f16a-483b-8614-6d7a3efc4725" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-a1cc863d-eb2b-4ac8-892c-d518f8af1766 req-fabcbfaf-5980-41b4-966f-98f3874e3fae service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received event network-changed-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-a1cc863d-eb2b-4ac8-892c-d518f8af1766 req-fabcbfaf-5980-41b4-966f-98f3874e3fae service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Refreshing instance network info cache due to event network-changed-f5a9844d-6be0-40d0-b103-f844c6c434a7. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a1cc863d-eb2b-4ac8-892c-d518f8af1766 req-fabcbfaf-5980-41b4-966f-98f3874e3fae service nova] Acquiring lock "refresh_cache-16812ff4-f16a-483b-8614-6d7a3efc4725" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Updating instance_info_cache with network_info: [{"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Releasing lock "refresh_cache-16812ff4-f16a-483b-8614-6d7a3efc4725" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Instance network_info: |[{"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a1cc863d-eb2b-4ac8-892c-d518f8af1766 req-fabcbfaf-5980-41b4-966f-98f3874e3fae service nova] Acquired lock "refresh_cache-16812ff4-f16a-483b-8614-6d7a3efc4725" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.network.neutron [req-a1cc863d-eb2b-4ac8-892c-d518f8af1766 req-fabcbfaf-5980-41b4-966f-98f3874e3fae service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Refreshing network info cache for port f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Start _get_guest_xml network_info=[{"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:59:39 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:39 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:59:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1276884057',display_name='tempest-DeleteServersTestJSON-server-1276884057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1276884057',id=17,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850ba4e0e0154650a7f939f83febd354',ramdisk_id='',reservation_id='r-8700zi12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-801555969',owner_user_name='tempest-DeleteServersTestJSON-801555969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:59:37Z,user_data=None,user_id='e8dca50ff83a4745ad4c40f641851b73',uuid=16812ff4-f16a-483b-8614-6d7a3efc4725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Converting VIF {"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:af,bridge_name='br-int',has_traffic_filtering=True,id=f5a9844d-6be0-40d0-b103-f844c6c434a7,network=Network(53bf6c94-b186-4a32-9940-fe5baf9ffc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a9844d-6b') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.objects.instance [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lazy-loading 'pci_devices' on Instance uuid 16812ff4-f16a-483b-8614-6d7a3efc4725 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:59:40 user nova-compute[72803]:   <uuid>16812ff4-f16a-483b-8614-6d7a3efc4725</uuid>
Aug 15 06:59:40 user nova-compute[72803]:   <name>instance-00000011</name>
Aug 15 06:59:40 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:59:40 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:59:40 user nova-compute[72803]:   <metadata>
Aug 15 06:59:40 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:59:40 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:59:40 user nova-compute[72803]:       <nova:name>tempest-DeleteServersTestJSON-server-1276884057</nova:name>
Aug 15 06:59:40 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:59:39</nova:creationTime>
Aug 15 06:59:40 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:59:40 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:59:40 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:59:40 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:59:40 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:59:40 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:59:40 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:59:40 user nova-compute[72803]:       <nova:owner>
Aug 15 06:59:40 user nova-compute[72803]:         <nova:user uuid="e8dca50ff83a4745ad4c40f641851b73">tempest-DeleteServersTestJSON-801555969-project-member</nova:user>
Aug 15 06:59:40 user nova-compute[72803]:         <nova:project uuid="850ba4e0e0154650a7f939f83febd354">tempest-DeleteServersTestJSON-801555969</nova:project>
Aug 15 06:59:40 user nova-compute[72803]:       </nova:owner>
Aug 15 06:59:40 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 06:59:40 user nova-compute[72803]:       <nova:ports>
Aug 15 06:59:40 user nova-compute[72803]:         <nova:port uuid="f5a9844d-6be0-40d0-b103-f844c6c434a7">
Aug 15 06:59:40 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 06:59:40 user nova-compute[72803]:         </nova:port>
Aug 15 06:59:40 user nova-compute[72803]:       </nova:ports>
Aug 15 06:59:40 user nova-compute[72803]:     </nova:instance>
Aug 15 06:59:40 user nova-compute[72803]:   </metadata>
Aug 15 06:59:40 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:59:40 user nova-compute[72803]:     <system>
Aug 15 06:59:40 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:59:40 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:59:40 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:59:40 user nova-compute[72803]:       <entry name="serial">16812ff4-f16a-483b-8614-6d7a3efc4725</entry>
Aug 15 06:59:40 user nova-compute[72803]:       <entry name="uuid">16812ff4-f16a-483b-8614-6d7a3efc4725</entry>
Aug 15 06:59:40 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:59:40 user nova-compute[72803]:     </system>
Aug 15 06:59:40 user nova-compute[72803]:   </sysinfo>
Aug 15 06:59:40 user nova-compute[72803]:   <os>
Aug 15 06:59:40 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:59:40 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:59:40 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:59:40 user nova-compute[72803]:   </os>
Aug 15 06:59:40 user nova-compute[72803]:   <features>
Aug 15 06:59:40 user nova-compute[72803]:     <acpi/>
Aug 15 06:59:40 user nova-compute[72803]:     <apic/>
Aug 15 06:59:40 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:59:40 user nova-compute[72803]:   </features>
Aug 15 06:59:40 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:59:40 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:59:40 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:59:40 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:59:40 user nova-compute[72803]:   </clock>
Aug 15 06:59:40 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:59:40 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:59:40 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:59:40 user nova-compute[72803]:   </cpu>
Aug 15 06:59:40 user nova-compute[72803]:   <devices>
Aug 15 06:59:40 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:59:40 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:59:40 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk"/>
Aug 15 06:59:40 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:59:40 user nova-compute[72803]:     </disk>
Aug 15 06:59:40 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:59:40 user nova-compute[72803]:       <mac address="fa:16:3e:aa:38:af"/>
Aug 15 06:59:40 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:59:40 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:59:40 user nova-compute[72803]:       <target dev="tapf5a9844d-6b"/>
Aug 15 06:59:40 user nova-compute[72803]:     </interface>
Aug 15 06:59:40 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:59:40 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/console.log" append="off"/>
Aug 15 06:59:40 user nova-compute[72803]:     </serial>
Aug 15 06:59:40 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:59:40 user nova-compute[72803]:     <video>
Aug 15 06:59:40 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:59:40 user nova-compute[72803]:     </video>
Aug 15 06:59:40 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:59:40 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:59:40 user nova-compute[72803]:     </rng>
Aug 15 06:59:40 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:59:40 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:59:40 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:59:40 user nova-compute[72803]:     </memballoon>
Aug 15 06:59:40 user nova-compute[72803]:   </devices>
Aug 15 06:59:40 user nova-compute[72803]: </domain>
Aug 15 06:59:40 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1276884057',display_name='tempest-DeleteServersTestJSON-server-1276884057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1276884057',id=17,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850ba4e0e0154650a7f939f83febd354',ramdisk_id='',reservation_id='r-8700zi12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-801555969',owner_user_name='tempest-DeleteServersTestJSON-801555969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:59:37Z,user_data=None,user_id='e8dca50ff83a4745ad4c40f641851b73',uuid=16812ff4-f16a-483b-8614-6d7a3efc4725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Converting VIF {"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:af,bridge_name='br-int',has_traffic_filtering=True,id=f5a9844d-6be0-40d0-b103-f844c6c434a7,network=Network(53bf6c94-b186-4a32-9940-fe5baf9ffc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a9844d-6b') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG os_vif [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:af,bridge_name='br-int',has_traffic_filtering=True,id=f5a9844d-6be0-40d0-b103-f844c6c434a7,network=Network(53bf6c94-b186-4a32-9940-fe5baf9ffc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a9844d-6b') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a9844d-6b, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5a9844d-6b, col_values=(('external_ids', {'iface-id': 'f5a9844d-6be0-40d0-b103-f844c6c434a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:38:af', 'vm-uuid': '16812ff4-f16a-483b-8614-6d7a3efc4725'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:40 user nova-compute[72803]: INFO os_vif [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:af,bridge_name='br-int',has_traffic_filtering=True,id=f5a9844d-6be0-40d0-b103-f844c6c434a7,network=Network(53bf6c94-b186-4a32-9940-fe5baf9ffc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a9844d-6b')
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] No VIF found with MAC fa:16:3e:aa:38:af, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-a1cc863d-eb2b-4ac8-892c-d518f8af1766 req-fabcbfaf-5980-41b4-966f-98f3874e3fae service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Updated VIF entry in instance network info cache for port f5a9844d-6be0-40d0-b103-f844c6c434a7. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-a1cc863d-eb2b-4ac8-892c-d518f8af1766 req-fabcbfaf-5980-41b4-966f-98f3874e3fae service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Updating instance_info_cache with network_info: [{"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a1cc863d-eb2b-4ac8-892c-d518f8af1766 req-fabcbfaf-5980-41b4-966f-98f3874e3fae service nova] Releasing lock "refresh_cache-16812ff4-f16a-483b-8614-6d7a3efc4725" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-1779ece8-5e03-4f45-921d-a3a5d5ca3c75 req-4705dcbe-825c-4c79-a2c9-0043a97d6ffe service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received event network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1779ece8-5e03-4f45-921d-a3a5d5ca3c75 req-4705dcbe-825c-4c79-a2c9-0043a97d6ffe service nova] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1779ece8-5e03-4f45-921d-a3a5d5ca3c75 req-4705dcbe-825c-4c79-a2c9-0043a97d6ffe service nova] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1779ece8-5e03-4f45-921d-a3a5d5ca3c75 req-4705dcbe-825c-4c79-a2c9-0043a97d6ffe service nova] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-1779ece8-5e03-4f45-921d-a3a5d5ca3c75 req-4705dcbe-825c-4c79-a2c9-0043a97d6ffe service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] No waiting events found dispatching network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:42 user nova-compute[72803]: WARNING nova.compute.manager [req-1779ece8-5e03-4f45-921d-a3a5d5ca3c75 req-4705dcbe-825c-4c79-a2c9-0043a97d6ffe service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received unexpected event network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 for instance with vm_state building and task_state spawning.
Aug 15 06:59:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'pci_requests' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'numa_topology' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:59:42 user nova-compute[72803]: INFO nova.compute.claims [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Claim successful on node user
Aug 15 06:59:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:43 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:43 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:43 user nova-compute[72803]: INFO nova.network.neutron [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 06:59:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082784.0227323, 16812ff4-f16a-483b-8614-6d7a3efc4725 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:44 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] VM Resumed (Lifecycle Event)
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:59:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Instance spawned successfully.
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-08926c97-5552-4a90-aee8-235804a3932b req-8904aff9-cdb2-4af1-8f9b-4a9d756eb2e4 service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received event network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-08926c97-5552-4a90-aee8-235804a3932b req-8904aff9-cdb2-4af1-8f9b-4a9d756eb2e4 service nova] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-08926c97-5552-4a90-aee8-235804a3932b req-8904aff9-cdb2-4af1-8f9b-4a9d756eb2e4 service nova] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-08926c97-5552-4a90-aee8-235804a3932b req-8904aff9-cdb2-4af1-8f9b-4a9d756eb2e4 service nova] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-08926c97-5552-4a90-aee8-235804a3932b req-8904aff9-cdb2-4af1-8f9b-4a9d756eb2e4 service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] No waiting events found dispatching network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:44 user nova-compute[72803]: WARNING nova.compute.manager [req-08926c97-5552-4a90-aee8-235804a3932b req-8904aff9-cdb2-4af1-8f9b-4a9d756eb2e4 service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received unexpected event network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 for instance with vm_state building and task_state spawning.
Aug 15 06:59:44 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082784.026596, 16812ff4-f16a-483b-8614-6d7a3efc4725 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:44 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] VM Started (Lifecycle Event)
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMVBYHzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:59:44 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:59:44 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:59:44 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:59:44 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee0b971-32e1-4a05-b7f5-8ed04220f551]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:59:44 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: INFO nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Took 6.75 seconds to spawn the instance on the hypervisor.
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5961672-07d3-4ba2-887a-ce8d0a9f2cc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f] added
Aug 15 06:59:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64e837-50ff-4aac-8e56-b6953b5a54ed]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0cd73c-57c4-4ec8-bead-04d24d77cd75]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquired lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMVBYHzm {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMVBYHzm" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: INFO nova.compute.manager [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Took 8.31 seconds to build instance.
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[53edc425-124c-46d0-a524-d6cb488aceba]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iMVBYHzm'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-527e0274-8460-4723-81db-ef4306afe7b3 req-f24c05fa-4ba2-4347-9298-da4f7d949d35 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-changed-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-527e0274-8460-4723-81db-ef4306afe7b3 req-f24c05fa-4ba2-4347-9298-da4f7d949d35 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Refreshing instance network info cache due to event network-changed-01af57c9-c09e-45b8-8ba5-c90a6c729ec9. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-527e0274-8460-4723-81db-ef4306afe7b3 req-f24c05fa-4ba2-4347-9298-da4f7d949d35 service nova] Acquiring lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-72e27860-9e2a-42fd-9b61-972e0d31ad16 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.423s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[661cbea5-fd24-408d-984b-887dc1e361b3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[376bc510-bbea-4029-b69f-61af6c94f5b2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:44 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:44 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fb9f77-9498-442a-989e-7392edc222db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f, portal: 172.16.0.220,3260]
Aug 15 06:59:44 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f, portal: 172.16.0.220,3260] successful.
Aug 15 06:59:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2ce007-e02f-417b-8953-ebf93799dab4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1405c742-f936-486b-9aa0-f58d05536407]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:44 user nova-compute[72803]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f (non-flash)
Aug 15 06:59:44 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:44 user nova-compute[72803]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f (non-flash)
Aug 15 06:59:44 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e6ed68-ec32-497d-92e5-df9f26c349bd]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMVBYHzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Releasing lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:59:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Creating image(s)
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'trusted_certs' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-527e0274-8460-4723-81db-ef4306afe7b3 req-f24c05fa-4ba2-4347-9298-da4f7d949d35 service nova] Acquired lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG nova.network.neutron [req-527e0274-8460-4723-81db-ef4306afe7b3 req-f24c05fa-4ba2-4347-9298-da4f7d949d35 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Refreshing network info cache for port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "384d16b3832c10f45ffdd491e81d48eac7caf034" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "384d16b3832c10f45ffdd491e81d48eac7caf034" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.084s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] <== connect_volume: return (2087ms) {'type': 'block', 'scsi_wwn': '26638313037653533', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638313037653533', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lazy-loading 'flavor' on Instance uuid 5fb89ce0-1cc3-4a6a-b812-c889f302584e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:59:46 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:59:46 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 06:59:46 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:59:46 user nova-compute[72803]:   <serial>77ce958e-1092-40a3-b107-94cca390ea2f</serial>
Aug 15 06:59:46 user nova-compute[72803]: </disk>
Aug 15 06:59:46 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034.part --force-share --output=json" returned: 0 in 0.205s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG nova.virt.images [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] 6f17a691-57f0-4d30-a577-227d2eeb57e7 was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034.part /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034.part /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034.converted" returned: 0 in 0.438s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:59:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] No VIF found with MAC fa:16:3e:8e:16:40, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034.converted --force-share --output=json" returned: 0 in 0.257s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "384d16b3832c10f45ffdd491e81d48eac7caf034" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.146s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG nova.network.neutron [req-527e0274-8460-4723-81db-ef4306afe7b3 req-f24c05fa-4ba2-4347-9298-da4f7d949d35 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updated VIF entry in instance network info cache for port 01af57c9-c09e-45b8-8ba5-c90a6c729ec9. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG nova.network.neutron [req-527e0274-8460-4723-81db-ef4306afe7b3 req-f24c05fa-4ba2-4347-9298-da4f7d949d35 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1c0d56a-c18d-4dce-baab-7a1145e53df9 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.988s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:47 user nova-compute[72803]: INFO nova.compute.manager [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Terminating instance
Aug 15 06:59:47 user nova-compute[72803]: DEBUG nova.compute.manager [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-527e0274-8460-4723-81db-ef4306afe7b3 req-f24c05fa-4ba2-4347-9298-da4f7d949d35 service nova] Releasing lock "refresh_cache-454ea345-aaa5-423b-add3-20a933978eec" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034 --force-share --output=json" returned: 0 in 0.293s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "384d16b3832c10f45ffdd491e81d48eac7caf034" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "384d16b3832c10f45ffdd491e81d48eac7caf034" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034 --force-share --output=json" returned: 0 in 0.258s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034,backing_fmt=raw /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-5e24aaee-2ffa-45d0-ad24-f8f3fa965e1e req-c9c46f27-4b1e-45a6-97b2-8c4e2332e9ad service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received event network-vif-unplugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5e24aaee-2ffa-45d0-ad24-f8f3fa965e1e req-c9c46f27-4b1e-45a6-97b2-8c4e2332e9ad service nova] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5e24aaee-2ffa-45d0-ad24-f8f3fa965e1e req-c9c46f27-4b1e-45a6-97b2-8c4e2332e9ad service nova] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5e24aaee-2ffa-45d0-ad24-f8f3fa965e1e req-c9c46f27-4b1e-45a6-97b2-8c4e2332e9ad service nova] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-5e24aaee-2ffa-45d0-ad24-f8f3fa965e1e req-c9c46f27-4b1e-45a6-97b2-8c4e2332e9ad service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] No waiting events found dispatching network-vif-unplugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-5e24aaee-2ffa-45d0-ad24-f8f3fa965e1e req-c9c46f27-4b1e-45a6-97b2-8c4e2332e9ad service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received event network-vif-unplugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034,backing_fmt=raw /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk 1073741824" returned: 0 in 0.076s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "384d16b3832c10f45ffdd491e81d48eac7caf034" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034 --force-share --output=json" returned: 0 in 0.217s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:47 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'migration_context' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:48 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Rebasing disk image.
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-e37d71b0-742e-444f-9b09-37288419c6bf req-7d15b148-224f-4f1b-88b7-4d4c00805fbc service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received event network-changed-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-e37d71b0-742e-444f-9b09-37288419c6bf req-7d15b148-224f-4f1b-88b7-4d4c00805fbc service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Refreshing instance network info cache due to event network-changed-3e51a234-0440-4398-84ac-ae703e9924d9. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e37d71b0-742e-444f-9b09-37288419c6bf req-7d15b148-224f-4f1b-88b7-4d4c00805fbc service nova] Acquiring lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e37d71b0-742e-444f-9b09-37288419c6bf req-7d15b148-224f-4f1b-88b7-4d4c00805fbc service nova] Acquired lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.network.neutron [req-e37d71b0-742e-444f-9b09-37288419c6bf req-7d15b148-224f-4f1b-88b7-4d4c00805fbc service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Refreshing network info cache for port 3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.282s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 -F raw /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:48 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Instance destroyed successfully.
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.objects.instance [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lazy-loading 'resources' on Instance uuid 0cb66e88-04aa-47cb-b403-16e16704a9f9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1956766012',display_name='tempest-TestVolumeSwap-server-1956766012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1956766012',id=9,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBUrgjUoG7/hhqUsST8WlOcK2IGvo6uGtK62aw/jCK5iJR121NCfTyCxodTvDuu4vCa9sUKIGN2JRTi1ZXwSENCbGqgLpr5ZYlnEu2+jSRfx3rBwdajPgYgN49ABqYcxg==',key_name='tempest-keypair-1865542447',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:56:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56258d381827464ea24efccfe501b213',ramdisk_id='',reservation_id='r-xu0b1nsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1505291325',owner_user_name='tempest-TestVolumeSwap-1505291325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:56:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab553427c4f0495aa6524aec1a7adc40',uuid=0cb66e88-04aa-47cb-b403-16e16704a9f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Converting VIF {"id": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "address": "fa:16:3e:87:01:db", "network": {"id": "38fea282-8fd4-4109-818b-982805385f7e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-17653120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56258d381827464ea24efccfe501b213", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360678a7-0b", "ovs_interfaceid": "360678a7-0b9e-453e-9a29-15e9b88ac0c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:01:db,bridge_name='br-int',has_traffic_filtering=True,id=360678a7-0b9e-453e-9a29-15e9b88ac0c4,network=Network(38fea282-8fd4-4109-818b-982805385f7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360678a7-0b') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG os_vif [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:01:db,bridge_name='br-int',has_traffic_filtering=True,id=360678a7-0b9e-453e-9a29-15e9b88ac0c4,network=Network(38fea282-8fd4-4109-818b-982805385f7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360678a7-0b') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap360678a7-0b, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:48 user nova-compute[72803]: INFO os_vif [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:01:db,bridge_name='br-int',has_traffic_filtering=True,id=360678a7-0b9e-453e-9a29-15e9b88ac0c4,network=Network(38fea282-8fd4-4109-818b-982805385f7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360678a7-0b')
Aug 15 06:59:48 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Deleting instance files /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9_del
Aug 15 06:59:48 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Deletion of /opt/stack/data/nova/instances/0cb66e88-04aa-47cb-b403-16e16704a9f9_del complete
Aug 15 06:59:48 user nova-compute[72803]: INFO nova.compute.manager [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:48 user nova-compute[72803]: INFO nova.compute.manager [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Terminating instance
Aug 15 06:59:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.network.neutron [req-e37d71b0-742e-444f-9b09-37288419c6bf req-7d15b148-224f-4f1b-88b7-4d4c00805fbc service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Updated VIF entry in instance network info cache for port 3e51a234-0440-4398-84ac-ae703e9924d9. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.network.neutron [req-e37d71b0-742e-444f-9b09-37288419c6bf req-7d15b148-224f-4f1b-88b7-4d4c00805fbc service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Updating instance_info_cache with network_info: [{"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:49 user nova-compute[72803]: INFO nova.compute.manager [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Detaching volume 77ce958e-1092-40a3-b107-94cca390ea2f
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e37d71b0-742e-444f-9b09-37288419c6bf req-7d15b148-224f-4f1b-88b7-4d4c00805fbc service nova] Releasing lock "refresh_cache-d543c8cd-83cf-4474-a35d-f3c7b7f08093" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:59:49 user nova-compute[72803]: INFO nova.virt.block_device [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Attempting to driver detach volume 77ce958e-1092-40a3-b107-94cca390ea2f from mountpoint /dev/vdb
Aug 15 06:59:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Attempting to detach device vdb from instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:59:49 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:59:49 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 06:59:49 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:59:49 user nova-compute[72803]:   <serial>77ce958e-1092-40a3-b107-94cca390ea2f</serial>
Aug 15 06:59:49 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:59:49 user nova-compute[72803]: </disk>
Aug 15 06:59:49 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Successfully detached device vdb from instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e from the persistent domain config.
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:59:49 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:59:49 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 06:59:49 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:59:49 user nova-compute[72803]:   <serial>77ce958e-1092-40a3-b107-94cca390ea2f</serial>
Aug 15 06:59:49 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:59:49 user nova-compute[72803]: </disk>
Aug 15 06:59:49 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:59:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Instance destroyed successfully.
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'resources' on Instance uuid d543c8cd-83cf-4474-a35d-f3c7b7f08093 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-251581683',display_name='tempest-AttachVolumeNegativeTest-server-251581683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-251581683',id=13,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOjp74boQAcPOzhfM5kBFlFgWgLHTvZ74B587wtfgYO/5CR09yT+Py9I3o0pqkTL/QHn/SbefwrNgF1kkVtNXYFMJLEqTztZmwGspr7D7FFCr0SzPo7mgGkMbYrJouGyQ==',key_name='tempest-keypair-911851804',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-wcw2zcyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=d543c8cd-83cf-4474-a35d-f3c7b7f08093,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "3e51a234-0440-4398-84ac-ae703e9924d9", "address": "fa:16:3e:f2:86:ed", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e51a234-04", "ovs_interfaceid": "3e51a234-0440-4398-84ac-ae703e9924d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:86:ed,bridge_name='br-int',has_traffic_filtering=True,id=3e51a234-0440-4398-84ac-ae703e9924d9,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e51a234-04') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG os_vif [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:86:ed,bridge_name='br-int',has_traffic_filtering=True,id=3e51a234-0440-4398-84ac-ae703e9924d9,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e51a234-04') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e51a234-04, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:59:49 user nova-compute[72803]: INFO os_vif [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:86:ed,bridge_name='br-int',has_traffic_filtering=True,id=3e51a234-0440-4398-84ac-ae703e9924d9,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e51a234-04')
Aug 15 06:59:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Deleting instance files /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093_del
Aug 15 06:59:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Deletion of /opt/stack/data/nova/instances/d543c8cd-83cf-4474-a35d-f3c7b7f08093_del complete
Aug 15 06:59:49 user nova-compute[72803]: INFO nova.compute.manager [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received event network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Acquiring lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] No waiting events found dispatching network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:49 user nova-compute[72803]: WARNING nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received unexpected event network-vif-plugged-360678a7-0b9e-453e-9a29-15e9b88ac0c4 for instance with vm_state active and task_state deleting.
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received event network-vif-unplugged-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Acquiring lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] No waiting events found dispatching network-vif-unplugged-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received event network-vif-unplugged-3e51a234-0440-4398-84ac-ae703e9924d9 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received event network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Acquiring lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] No waiting events found dispatching network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:49 user nova-compute[72803]: WARNING nova.compute.manager [req-5a5eb304-321d-4e29-9388-0f830b2a44f9 req-13e54587-6171-4054-ae3c-f0fdbf5bb7eb service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received unexpected event network-vif-plugged-3e51a234-0440-4398-84ac-ae703e9924d9 for instance with vm_state active and task_state deleting.
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-37fca848-4549-4ffc-8cf1-27dd95cc73a0 req-db1be271-d9fc-4d15-92ab-7a5a953983e7 service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Received event network-vif-deleted-360678a7-0b9e-453e-9a29-15e9b88ac0c4 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:50 user nova-compute[72803]: INFO nova.compute.manager [req-37fca848-4549-4ffc-8cf1-27dd95cc73a0 req-db1be271-d9fc-4d15-92ab-7a5a953983e7 service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Neutron deleted interface 360678a7-0b9e-453e-9a29-15e9b88ac0c4; detaching it from the instance and deleting it from the info cache
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-37fca848-4549-4ffc-8cf1-27dd95cc73a0 req-db1be271-d9fc-4d15-92ab-7a5a953983e7 service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692082790.3008695, 5fb89ce0-1cc3-4a6a-b812-c889f302584e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-37fca848-4549-4ffc-8cf1-27dd95cc73a0 req-db1be271-d9fc-4d15-92ab-7a5a953983e7 service nova] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Detach interface failed, port_id=360678a7-0b9e-453e-9a29-15e9b88ac0c4, reason: Instance 0cb66e88-04aa-47cb-b403-16e16704a9f9 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 06:59:50 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Took 1.70 seconds to deallocate network for instance.
Aug 15 06:59:50 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Successfully detached device vdb from instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e from the live domain config.
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMVBYHzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:59:50 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5e8edf-2680-4cbb-a0ad-b02d46e43352]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3e695a-af80-4448-acc0-44ae0b3893a9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:50 user nova-compute[72803]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f (non-flash)
Aug 15 06:59:50 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:50 user nova-compute[72803]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f (non-flash)
Aug 15 06:59:50 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c07db640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9131966d-982f-4ad0-805b-4e68904f1864]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0ed809-ddd5-4978-a9cc-3d52f1ae46b6]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8893f00b-2203-491e-911d-0bf8f088a035]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.081s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76d143-8a03-4bae-9ad5-478cf0020a1e]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[991e4d91-bcf4-436e-9c46-e6cf6a3b433a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e3995a-e4fd-4e9d-9452-d252b9cfbcea]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f, portal: 172.16.0.220,3260]
Aug 15 06:59:50 user nova-compute[72803]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f, portal: 172.16.0.220,3260] successful.
Aug 15 06:59:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce958e-1092-40a3-b107-94cca390ea2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6d5a51-3dcf-4145-a672-60132669a399]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] <== disconnect_volume: return (405ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:50 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Deleted allocations for instance 0cb66e88-04aa-47cb-b403-16e16704a9f9
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-82214653-6867-46fa-b7db-b7c7c58c23de tempest-TestVolumeSwap-1505291325 tempest-TestVolumeSwap-1505291325-project-member] Lock "0cb66e88-04aa-47cb-b403-16e16704a9f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.188s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 -F raw /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk" returned: 0 in 3.107s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Ensure instance console log exists: /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Start _get_guest_xml network_info=[{"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='594abacfc81027cd3103820f2fb104b3',container_format='bare',created_at=2023-08-15T06:57:36Z,direct_url=<?>,disk_format='qcow2',id=6f17a691-57f0-4d30-a577-227d2eeb57e7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1152789104-shelved',owner='f7937188c3cb441fa4f4348d2e3b2573',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T06:57:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'ff4cc9b3-72bf-42ce-969c-91d9146b9ef9', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyOgYVtE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '454ea345-aaa5-423b-add3-20a933978eec', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5491415-5196-4845-b334-b4b31baadcac', 'serial': 'c5491415-5196-4845-b334-b4b31baadcac'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:59:51 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:51 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='594abacfc81027cd3103820f2fb104b3',container_format='bare',created_at=2023-08-15T06:57:36Z,direct_url=<?>,disk_format='qcow2',id=6f17a691-57f0-4d30-a577-227d2eeb57e7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1152789104-shelved',owner='f7937188c3cb441fa4f4348d2e3b2573',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T06:57:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'vcpu_model' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyOgYVtE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:59:51 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:59:51 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:59:51 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[01064109-b22d-41c2-b6dc-5c54bb2a2925]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:59:51 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a24c91-6d45-459c-b187-2f76ee40720a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac] added
Aug 15 06:59:51 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.059s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530baf9-01e4-40b6-9317-6d61fcd11c3c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a97ff-63d9-458e-a371-d768c5f57e5f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyOgYVtE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyOgYVtE" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f4ec60-09f2-4b7a-8e3f-96bff4f85c32]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cyOgYVtE'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ac197-5861-4c5b-a177-72328532feb5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.objects.instance [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lazy-loading 'flavor' on Instance uuid 5fb89ce0-1cc3-4a6a-b812-c889f302584e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Took 1.99 seconds to deallocate network for instance.
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5276c-9d50-4fe4-8fd3-ba4b7d4421eb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:51 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:51 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:51 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:51 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-7cafe409-b61f-4c67-ae12-a55703cf4f41 req-b638c1a9-0847-4c9f-80bb-0734fe8e1b9e service nova] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Received event network-vif-deleted-3e51a234-0440-4398-84ac-ae703e9924d9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6aac6c1b-51ad-483c-8dbb-6a34d45a88e4 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.426s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89e86fc-86d1-47ed-b85f-f63938b481b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac, portal: 172.16.0.220,3260]
Aug 15 06:59:51 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac, portal: 172.16.0.220,3260] successful.
Aug 15 06:59:51 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[82afbbc9-f298-4808-b4a6-01c5f696e6e9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cde108-8212-4a3d-8739-689621365097]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:51 user nova-compute[72803]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)
Aug 15 06:59:51 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:51 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 06:59:51 user nova-compute[72803]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)
Aug 15 06:59:51 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 06:59:51 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fda6c0-d8be-4840-b4a8-11540206a94b]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:59:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyOgYVtE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:52 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Deleted allocations for instance d543c8cd-83cf-4474-a35d-f3c7b7f08093
Aug 15 06:59:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5c6e726e-0798-4765-996a-c06ecdb5b787 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "d543c8cd-83cf-4474-a35d-f3c7b7f08093" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.711s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '26264373438663265', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264373438663265', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T06:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1152789104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1152789104',id=2,image_ref='6f17a691-57f0-4d30-a577-227d2eeb57e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-577174082',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-11vl8r1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member',shelved_at='2023-08-15T06:57:43.118617',shelved_host='user',shelved_image_id='6f17a691-57f0-4d30-a577-227d2eeb57e7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:59:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=454ea345-aaa5-423b-add3-20a933978eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:52 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'pci_devices' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:59:53 user nova-compute[72803]:   <uuid>454ea345-aaa5-423b-add3-20a933978eec</uuid>
Aug 15 06:59:53 user nova-compute[72803]:   <name>instance-00000002</name>
Aug 15 06:59:53 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 06:59:53 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 06:59:53 user nova-compute[72803]:   <metadata>
Aug 15 06:59:53 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:59:53 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 06:59:53 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1152789104</nova:name>
Aug 15 06:59:53 user nova-compute[72803]:       <nova:creationTime>2023-08-15 06:59:51</nova:creationTime>
Aug 15 06:59:53 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 06:59:53 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 06:59:53 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 06:59:53 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 06:59:53 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:59:53 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:59:53 user nova-compute[72803]:       </nova:flavor>
Aug 15 06:59:53 user nova-compute[72803]:       <nova:owner>
Aug 15 06:59:53 user nova-compute[72803]:         <nova:user uuid="35a29bfde8d746f9b15c12e31a925c47">tempest-AttachVolumeShelveTestJSON-758519316-project-member</nova:user>
Aug 15 06:59:53 user nova-compute[72803]:         <nova:project uuid="f7937188c3cb441fa4f4348d2e3b2573">tempest-AttachVolumeShelveTestJSON-758519316</nova:project>
Aug 15 06:59:53 user nova-compute[72803]:       </nova:owner>
Aug 15 06:59:53 user nova-compute[72803]:       <nova:root type="image" uuid="6f17a691-57f0-4d30-a577-227d2eeb57e7"/>
Aug 15 06:59:53 user nova-compute[72803]:       <nova:ports>
Aug 15 06:59:53 user nova-compute[72803]:         <nova:port uuid="01af57c9-c09e-45b8-8ba5-c90a6c729ec9">
Aug 15 06:59:53 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 06:59:53 user nova-compute[72803]:         </nova:port>
Aug 15 06:59:53 user nova-compute[72803]:       </nova:ports>
Aug 15 06:59:53 user nova-compute[72803]:     </nova:instance>
Aug 15 06:59:53 user nova-compute[72803]:   </metadata>
Aug 15 06:59:53 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 06:59:53 user nova-compute[72803]:     <system>
Aug 15 06:59:53 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:59:53 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:59:53 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 06:59:53 user nova-compute[72803]:       <entry name="serial">454ea345-aaa5-423b-add3-20a933978eec</entry>
Aug 15 06:59:53 user nova-compute[72803]:       <entry name="uuid">454ea345-aaa5-423b-add3-20a933978eec</entry>
Aug 15 06:59:53 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:59:53 user nova-compute[72803]:     </system>
Aug 15 06:59:53 user nova-compute[72803]:   </sysinfo>
Aug 15 06:59:53 user nova-compute[72803]:   <os>
Aug 15 06:59:53 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:59:53 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 06:59:53 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 06:59:53 user nova-compute[72803]:   </os>
Aug 15 06:59:53 user nova-compute[72803]:   <features>
Aug 15 06:59:53 user nova-compute[72803]:     <acpi/>
Aug 15 06:59:53 user nova-compute[72803]:     <apic/>
Aug 15 06:59:53 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 06:59:53 user nova-compute[72803]:   </features>
Aug 15 06:59:53 user nova-compute[72803]:   <clock offset="utc">
Aug 15 06:59:53 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:59:53 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:59:53 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 06:59:53 user nova-compute[72803]:   </clock>
Aug 15 06:59:53 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 06:59:53 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 06:59:53 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:59:53 user nova-compute[72803]:   </cpu>
Aug 15 06:59:53 user nova-compute[72803]:   <devices>
Aug 15 06:59:53 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 06:59:53 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:59:53 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk"/>
Aug 15 06:59:53 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 06:59:53 user nova-compute[72803]:     </disk>
Aug 15 06:59:53 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 06:59:53 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:59:53 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 06:59:53 user nova-compute[72803]:       <target dev="vdc" bus="virtio"/>
Aug 15 06:59:53 user nova-compute[72803]:       <serial>c5491415-5196-4845-b334-b4b31baadcac</serial>
Aug 15 06:59:53 user nova-compute[72803]:     </disk>
Aug 15 06:59:53 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 06:59:53 user nova-compute[72803]:       <mac address="fa:16:3e:47:dd:5e"/>
Aug 15 06:59:53 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:59:53 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 06:59:53 user nova-compute[72803]:       <target dev="tap01af57c9-c0"/>
Aug 15 06:59:53 user nova-compute[72803]:     </interface>
Aug 15 06:59:53 user nova-compute[72803]:     <serial type="pty">
Aug 15 06:59:53 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/console.log" append="off"/>
Aug 15 06:59:53 user nova-compute[72803]:     </serial>
Aug 15 06:59:53 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:59:53 user nova-compute[72803]:     <video>
Aug 15 06:59:53 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 06:59:53 user nova-compute[72803]:     </video>
Aug 15 06:59:53 user nova-compute[72803]:     <rng model="virtio">
Aug 15 06:59:53 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:59:53 user nova-compute[72803]:     </rng>
Aug 15 06:59:53 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:59:53 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 06:59:53 user nova-compute[72803]:       <stats period="10"/>
Aug 15 06:59:53 user nova-compute[72803]:     </memballoon>
Aug 15 06:59:53 user nova-compute[72803]:   </devices>
Aug 15 06:59:53 user nova-compute[72803]: </domain>
Aug 15 06:59:53 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T06:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1152789104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1152789104',id=2,image_ref='6f17a691-57f0-4d30-a577-227d2eeb57e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-577174082',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-11vl8r1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member',shelved_at='2023-08-15T06:57:43.118617',shelved_host='user',shelved_image_id='6f17a691-57f0-4d30-a577-227d2eeb57e7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:59:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=454ea345-aaa5-423b-add3-20a933978eec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG os_vif [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01af57c9-c0, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01af57c9-c0, col_values=(('external_ids', {'iface-id': '01af57c9-c09e-45b8-8ba5-c90a6c729ec9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:dd:5e', 'vm-uuid': '454ea345-aaa5-423b-add3-20a933978eec'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:53 user nova-compute[72803]: INFO os_vif [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0')
Aug 15 06:59:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No VIF found with MAC fa:16:3e:47:dd:5e, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:59:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-d4f6419a-5aad-4a17-97cd-cb8ab57346c3 req-ddb9540c-b7b2-487e-8e4e-efb661fafd46 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d4f6419a-5aad-4a17-97cd-cb8ab57346c3 req-ddb9540c-b7b2-487e-8e4e-efb661fafd46 service nova] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d4f6419a-5aad-4a17-97cd-cb8ab57346c3 req-ddb9540c-b7b2-487e-8e4e-efb661fafd46 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d4f6419a-5aad-4a17-97cd-cb8ab57346c3 req-ddb9540c-b7b2-487e-8e4e-efb661fafd46 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-d4f6419a-5aad-4a17-97cd-cb8ab57346c3 req-ddb9540c-b7b2-487e-8e4e-efb661fafd46 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] No waiting events found dispatching network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:55 user nova-compute[72803]: WARNING nova.compute.manager [req-d4f6419a-5aad-4a17-97cd-cb8ab57346c3 req-ddb9540c-b7b2-487e-8e4e-efb661fafd46 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received unexpected event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082797.445233, 454ea345-aaa5-423b-add3-20a933978eec => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:57 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] VM Resumed (Lifecycle Event)
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:59:57 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance spawned successfully.
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-1065a7ac-addd-48ee-8247-65637abd648a req-4d7a485f-0395-4547-8ae9-e5f9d8124e90 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1065a7ac-addd-48ee-8247-65637abd648a req-4d7a485f-0395-4547-8ae9-e5f9d8124e90 service nova] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1065a7ac-addd-48ee-8247-65637abd648a req-4d7a485f-0395-4547-8ae9-e5f9d8124e90 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1065a7ac-addd-48ee-8247-65637abd648a req-4d7a485f-0395-4547-8ae9-e5f9d8124e90 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-1065a7ac-addd-48ee-8247-65637abd648a req-4d7a485f-0395-4547-8ae9-e5f9d8124e90 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] No waiting events found dispatching network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:59:57 user nova-compute[72803]: WARNING nova.compute.manager [req-1065a7ac-addd-48ee-8247-65637abd648a req-4d7a485f-0395-4547-8ae9-e5f9d8124e90 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received unexpected event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 06:59:57 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082797.449489, 454ea345-aaa5-423b-add3-20a933978eec => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:59:57 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] VM Started (Lifecycle Event)
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:59:57 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:59:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:59:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1f6d4a2e-ad06-41c3-a828-84318c3cd878 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.214s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:59:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:59:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:03 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082788.3973455, 0cb66e88-04aa-47cb-b403-16e16704a9f9 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:00:03 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] VM Stopped (Lifecycle Event)
Aug 15 07:00:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d74f6dd8-b0a1-4357-9d74-085cfbe33686 None None] [instance: 0cb66e88-04aa-47cb-b403-16e16704a9f9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:00:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:04 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082789.6418862, d543c8cd-83cf-4474-a35d-f3c7b7f08093 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:00:04 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] VM Stopped (Lifecycle Event)
Aug 15 07:00:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b4dc7da4-be2b-4d0a-b3b5-e46a19e60aad None None] [instance: d543c8cd-83cf-4474-a35d-f3c7b7f08093] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:00:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:12 user nova-compute[72803]: INFO nova.compute.manager [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Rescuing
Aug 15 07:00:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:00:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquired lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:00:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:00:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updating instance_info_cache with network_info: [{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:00:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Releasing lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:00:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-a591d0cb-1a3f-4c78-8e14-543570b4622f req-c31043e6-c19e-4b44-b624-48fb6c57f0d7 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a591d0cb-1a3f-4c78-8e14-543570b4622f req-c31043e6-c19e-4b44-b624-48fb6c57f0d7 service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a591d0cb-1a3f-4c78-8e14-543570b4622f req-c31043e6-c19e-4b44-b624-48fb6c57f0d7 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a591d0cb-1a3f-4c78-8e14-543570b4622f req-c31043e6-c19e-4b44-b624-48fb6c57f0d7 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-a591d0cb-1a3f-4c78-8e14-543570b4622f req-c31043e6-c19e-4b44-b624-48fb6c57f0d7 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:00:13 user nova-compute[72803]: WARNING nova.compute.manager [req-a591d0cb-1a3f-4c78-8e14-543570b4622f req-c31043e6-c19e-4b44-b624-48fb6c57f0d7 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state active and task_state rescuing.
Aug 15 07:00:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance destroyed successfully.
Aug 15 07:00:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Attempting a stable device rescue
Aug 15 07:00:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72803) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance directory exists: not creating {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 07:00:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Creating image(s)
Aug 15 07:00:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "/opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "/opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG nova.objects.instance [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "0ec0921144432c1f1f043eac7424e8d5d0072325" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "0ec0921144432c1f1f043eac7424e8d5d0072325" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-b100939e-c59a-470a-b3f1-e8b992f9f340 req-c2b66387-3e5a-4150-9580-d15169157d68 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b100939e-c59a-470a-b3f1-e8b992f9f340 req-c2b66387-3e5a-4150-9580-d15169157d68 service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b100939e-c59a-470a-b3f1-e8b992f9f340 req-c2b66387-3e5a-4150-9580-d15169157d68 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b100939e-c59a-470a-b3f1-e8b992f9f340 req-c2b66387-3e5a-4150-9580-d15169157d68 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-b100939e-c59a-470a-b3f1-e8b992f9f340 req-c2b66387-3e5a-4150-9580-d15169157d68 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:00:15 user nova-compute[72803]: WARNING nova.compute.manager [req-b100939e-c59a-470a-b3f1-e8b992f9f340 req-c2b66387-3e5a-4150-9580-d15169157d68 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state active and task_state rescuing.
Aug 15 07:00:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325.part --force-share --output=json" returned: 0 in 0.307s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG nova.virt.images [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] 925bd434-1e76-41d5-ad67-af6020875e76 was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:00:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325.part /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325.part /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325.converted" returned: 0 in 0.345s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "0ec0921144432c1f1f043eac7424e8d5d0072325" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.517s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "0ec0921144432c1f1f043eac7424e8d5d0072325" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "0ec0921144432c1f1f043eac7424e8d5d0072325" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325 --force-share --output=json" returned: 0 in 0.171s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325,backing_fmt=raw /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325,backing_fmt=raw /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue" returned: 0 in 0.049s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "0ec0921144432c1f1f043eac7424e8d5d0072325" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.objects.instance [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'migration_context' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Start _get_guest_xml network_info=[{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "vif_mac": "fa:16:3e:de:30:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '925bd434-1e76-41d5-ad67-af6020875e76', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '11bb6fe7-ad63-48fb-9720-daabc179ab95', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdFWucmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'a4a01678-2255-4fb5-a497-1ceaab81422a', 'attached_at': '', 'detached_at': '', 'volume_id': '951d2906-a088-45d0-928d-baa14cee31b9', 'serial': '951d2906-a088-45d0-928d-baa14cee31b9'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.objects.instance [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'resources' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.objects.instance [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'numa_topology' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:16 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:00:16 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.objects.instance [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdFWucmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:00:16 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:00:16 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:00:16 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0987a4d5-548d-4027-b3df-734ed1bce5b2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BdFWucmI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 07:00:16 user nova-compute[72803]: node.name = iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9
Aug 15 07:00:16 user nova-compute[72803]: node.tpgt = -1
Aug 15 07:00:16 user nova-compute[72803]: node.startup = automatic
Aug 15 07:00:16 user nova-compute[72803]: node.leading_login = No
Aug 15 07:00:16 user nova-compute[72803]: iface.iscsi_ifacename = default
Aug 15 07:00:16 user nova-compute[72803]: iface.net_ifacename = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.ipaddress = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.prefix_len = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.hwaddress = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.transport_name = tcp
Aug 15 07:00:16 user nova-compute[72803]: iface.initiatorname = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.state = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.vlan_id = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.vlan_priority = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.vlan_state = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.iface_num = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.mtu = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.port = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.bootproto = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.subnet_mask = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.gateway = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.dhcp_alt_client_id = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.dhcp_dns = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.dhcp_learn_iqn = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.dhcp_vendor_id_state = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.dhcp_vendor_id = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.dhcp_slp_da = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.fragmentation = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.gratuitous_arp = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.incoming_forwarding = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.tos_state = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.tos = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.ttl = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.delayed_ack = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.tcp_nagle = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.tcp_wsf_state = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.tcp_wsf = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.tcp_timer_scale = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.tcp_timestamp = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.redirect = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.def_task_mgmt_timeout = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.header_digest = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.data_digest = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.immediate_data = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.initial_r2t = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.data_seq_inorder = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.data_pdu_inorder = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.erl = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.max_receive_data_len = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.first_burst_len = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.max_outstanding_r2t = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.max_burst_len = 0
Aug 15 07:00:16 user nova-compute[72803]: iface.chap_auth = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.bidi_chap = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.strict_login_compliance = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.discovery_auth = <empty>
Aug 15 07:00:16 user nova-compute[72803]: iface.discovery_logout = <empty>
Aug 15 07:00:16 user nova-compute[72803]: node.discovery_address = <empty>
Aug 15 07:00:16 user nova-compute[72803]: node.discovery_port = 0
Aug 15 07:00:16 user nova-compute[72803]: node.discovery_type = static
Aug 15 07:00:16 user nova-compute[72803]: node.session.initial_cmdsn = 0
Aug 15 07:00:16 user nova-compute[72803]: node.session.initial_login_retry_max = 8
Aug 15 07:00:16 user nova-compute[72803]: node.session.xmit_thread_priority = -20
Aug 15 07:00:16 user nova-compute[72803]: node.session.cmds_max = 128
Aug 15 07:00:16 user nova-compute[72803]: node.session.queue_depth = 32
Aug 15 07:00:16 user nova-compute[72803]: node.session.nr_sessions = 1
Aug 15 07:00:16 user nova-compute[72803]: node.session.auth.authmethod = CHAP
Aug 15 07:00:16 user nova-compute[72803]: node.session.auth.username = BdFWucmI
Aug 15 07:00:16 user nova-compute[72803]: node.session.auth.password = ***
Aug 15 07:00:16 user nova-compute[72803]: node.session.auth.username_in = <empty>
Aug 15 07:00:16 user nova-compute[72803]: node.session.auth.password_in = <empty>
Aug 15 07:00:16 user nova-compute[72803]: node.session.auth.chap_algs = MD5
Aug 15 07:00:16 user nova-compute[72803]: node.session.timeo.replacement_timeout = 120
Aug 15 07:00:16 user nova-compute[72803]: node.session.err_timeo.abort_timeout = 15
Aug 15 07:00:16 user nova-compute[72803]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 07:00:16 user nova-compute[72803]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 07:00:16 user nova-compute[72803]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.FastAbort = Yes
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.InitialR2T = No
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.ImmediateData = Yes
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.MaxConnections = 1
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 07:00:16 user nova-compute[72803]: node.session.iscsi.ERL = 0
Aug 15 07:00:16 user nova-compute[72803]: node.session.scan = manual
Aug 15 07:00:16 user nova-compute[72803]: node.session.reopen_max = 0
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].address = 172.16.0.220
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].port = 3260
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].startup = manual
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].tcp.window_size = 524288
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].tcp.type_of_service = 0
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].timeo.logout_timeout = 15
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].timeo.login_timeout = 15
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].timeo.auth_timeout = 45
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].iscsi.DataDigest = None
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].iscsi.IFMarker = No
Aug 15 07:00:16 user nova-compute[72803]: node.conn[0].iscsi.OFMarker = No
Aug 15 07:00:16 user nova-compute[72803]: # END RECORD
Aug 15 07:00:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3582dc7e-d3e6-4d00-aff4-600bc205feed]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2ad0f3-8fda-4566-bb85-280ade4f089b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdFWucmI {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdFWucmI" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3de964-13d1-4af4-ae40-0c4a80334598]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BdFWucmI'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[38991341-9052-4012-bdf0-16ba4f0e64c5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ba7691-55ab-4cd3-acd4-8131e463e07d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:00:16 user nova-compute[72803]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)
Aug 15 07:00:16 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 07:00:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:00:16 user nova-compute[72803]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)
Aug 15 07:00:16 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 07:00:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] HCTL ('40', '0', '0', 0) found on session 14 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e547dc50-a7e3-4a96-813f-190bdf529be7]: (4, ('0 0 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching for a device in session 14 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdFWucmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] <== connect_volume: return (192ms) {'type': 'block', 'scsi_wwn': '23532346265303663', 'path': '/dev/sdi'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532346265303663', 'path': '/dev/sdi'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:58:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1334484337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1334484337',id=14,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-qxngkyu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:58:44Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=a4a01678-2255-4fb5-a497-1ceaab81422a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "vif_mac": "fa:16:3e:de:30:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "vif_mac": "fa:16:3e:de:30:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:30:72,bridge_name='br-int',has_traffic_filtering=True,id=8a8e9364-b7d1-4faf-9133-bd7c07abe0fa,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8e9364-b7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.objects.instance [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'pci_devices' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:00:16 user nova-compute[72803]:   <uuid>a4a01678-2255-4fb5-a497-1ceaab81422a</uuid>
Aug 15 07:00:16 user nova-compute[72803]:   <name>instance-0000000e</name>
Aug 15 07:00:16 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:00:16 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:00:16 user nova-compute[72803]:   <metadata>
Aug 15 07:00:16 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:00:16 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:00:16 user nova-compute[72803]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1334484337</nova:name>
Aug 15 07:00:16 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:00:16</nova:creationTime>
Aug 15 07:00:16 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:00:16 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:00:16 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:00:16 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:00:16 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:00:16 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:00:16 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:00:16 user nova-compute[72803]:       <nova:owner>
Aug 15 07:00:16 user nova-compute[72803]:         <nova:user uuid="bc7ee5090ba54d4b8acbd4c9f84835f3">tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member</nova:user>
Aug 15 07:00:16 user nova-compute[72803]:         <nova:project uuid="07ede5bd5cb24059bc4a185badef865d">tempest-ServerBootFromVolumeStableRescueTest-1860507335</nova:project>
Aug 15 07:00:16 user nova-compute[72803]:       </nova:owner>
Aug 15 07:00:16 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:00:16 user nova-compute[72803]:       <nova:ports>
Aug 15 07:00:16 user nova-compute[72803]:         <nova:port uuid="8a8e9364-b7d1-4faf-9133-bd7c07abe0fa">
Aug 15 07:00:16 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:00:16 user nova-compute[72803]:         </nova:port>
Aug 15 07:00:16 user nova-compute[72803]:       </nova:ports>
Aug 15 07:00:16 user nova-compute[72803]:     </nova:instance>
Aug 15 07:00:16 user nova-compute[72803]:   </metadata>
Aug 15 07:00:16 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:00:16 user nova-compute[72803]:     <system>
Aug 15 07:00:16 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:00:16 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:00:16 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:00:16 user nova-compute[72803]:       <entry name="serial">a4a01678-2255-4fb5-a497-1ceaab81422a</entry>
Aug 15 07:00:16 user nova-compute[72803]:       <entry name="uuid">a4a01678-2255-4fb5-a497-1ceaab81422a</entry>
Aug 15 07:00:16 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:00:16 user nova-compute[72803]:     </system>
Aug 15 07:00:16 user nova-compute[72803]:   </sysinfo>
Aug 15 07:00:16 user nova-compute[72803]:   <os>
Aug 15 07:00:16 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:00:16 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:00:16 user nova-compute[72803]:   </os>
Aug 15 07:00:16 user nova-compute[72803]:   <features>
Aug 15 07:00:16 user nova-compute[72803]:     <acpi/>
Aug 15 07:00:16 user nova-compute[72803]:     <apic/>
Aug 15 07:00:16 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:00:16 user nova-compute[72803]:   </features>
Aug 15 07:00:16 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:00:16 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:00:16 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:00:16 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:00:16 user nova-compute[72803]:   </clock>
Aug 15 07:00:16 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:00:16 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:00:16 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:00:16 user nova-compute[72803]:   </cpu>
Aug 15 07:00:16 user nova-compute[72803]:   <devices>
Aug 15 07:00:16 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:00:16 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:00:16 user nova-compute[72803]:       <source dev="/dev/sdi"/>
Aug 15 07:00:16 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:00:16 user nova-compute[72803]:       <serial>951d2906-a088-45d0-928d-baa14cee31b9</serial>
Aug 15 07:00:16 user nova-compute[72803]:     </disk>
Aug 15 07:00:16 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:00:16 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:00:16 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue"/>
Aug 15 07:00:16 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:00:16 user nova-compute[72803]:       <boot order="1"/>
Aug 15 07:00:16 user nova-compute[72803]:     </disk>
Aug 15 07:00:16 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:00:16 user nova-compute[72803]:       <mac address="fa:16:3e:de:30:72"/>
Aug 15 07:00:16 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:00:16 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:00:16 user nova-compute[72803]:       <target dev="tap8a8e9364-b7"/>
Aug 15 07:00:16 user nova-compute[72803]:     </interface>
Aug 15 07:00:16 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:00:16 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/console.log" append="off"/>
Aug 15 07:00:16 user nova-compute[72803]:     </serial>
Aug 15 07:00:16 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:00:16 user nova-compute[72803]:     <video>
Aug 15 07:00:16 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:00:16 user nova-compute[72803]:     </video>
Aug 15 07:00:16 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:00:16 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:00:16 user nova-compute[72803]:     </rng>
Aug 15 07:00:16 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:00:16 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:00:16 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:00:16 user nova-compute[72803]:     </memballoon>
Aug 15 07:00:16 user nova-compute[72803]:   </devices>
Aug 15 07:00:16 user nova-compute[72803]: </domain>
Aug 15 07:00:16 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:00:16 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance destroyed successfully.
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:00:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No VIF found with MAC fa:16:3e:de:30:72, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-76178733-0b17-4fb1-adaa-68cc31c1485e req-20808f8a-2adc-4a20-8922-6ab0bb7a0d5a service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-76178733-0b17-4fb1-adaa-68cc31c1485e req-20808f8a-2adc-4a20-8922-6ab0bb7a0d5a service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-76178733-0b17-4fb1-adaa-68cc31c1485e req-20808f8a-2adc-4a20-8922-6ab0bb7a0d5a service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-76178733-0b17-4fb1-adaa-68cc31c1485e req-20808f8a-2adc-4a20-8922-6ab0bb7a0d5a service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-76178733-0b17-4fb1-adaa-68cc31c1485e req-20808f8a-2adc-4a20-8922-6ab0bb7a0d5a service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:00:18 user nova-compute[72803]: WARNING nova.compute.manager [req-76178733-0b17-4fb1-adaa-68cc31c1485e req-20808f8a-2adc-4a20-8922-6ab0bb7a0d5a service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state active and task_state rescuing.
Aug 15 07:00:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for a4a01678-2255-4fb5-a497-1ceaab81422a due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082820.605942, a4a01678-2255-4fb5-a497-1ceaab81422a => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:00:20 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] VM Resumed (Lifecycle Event)
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-278ef3b8-e161-4292-91d5-8d616024f95c tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-3c721620-307b-488e-abf6-faac92837839 req-23c072ef-9597-4c56-99b9-f1322605b86f service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c721620-307b-488e-abf6-faac92837839 req-23c072ef-9597-4c56-99b9-f1322605b86f service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c721620-307b-488e-abf6-faac92837839 req-23c072ef-9597-4c56-99b9-f1322605b86f service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c721620-307b-488e-abf6-faac92837839 req-23c072ef-9597-4c56-99b9-f1322605b86f service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-3c721620-307b-488e-abf6-faac92837839 req-23c072ef-9597-4c56-99b9-f1322605b86f service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:00:20 user nova-compute[72803]: WARNING nova.compute.manager [req-3c721620-307b-488e-abf6-faac92837839 req-23c072ef-9597-4c56-99b9-f1322605b86f service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state active and task_state rescuing.
Aug 15 07:00:20 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082820.6117582, a4a01678-2255-4fb5-a497-1ceaab81422a => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:00:20 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] VM Started (Lifecycle Event)
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:00:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:00:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:00:29 user nova-compute[72803]: INFO nova.compute.claims [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Claim successful on node user
Aug 15 07:00:29 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:00:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:00:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:00:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG nova.policy [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeef867bec97404e9bd1f9810b93ba29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa20f14f0f14b6791cce17d3fec420d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:00:30 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Creating image(s)
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.224s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk 1073741824" returned: 0 in 0.060s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.217s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updating instance_info_cache with network_info: [{"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Successfully created port: 7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Cannot resize image /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'migration_context' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Ensure instance console log exists: /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Successfully updated port: 7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquired lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-6091d38c-ff6f-48d6-9f9d-d008cff669e3 req-a76defea-636b-4c7b-a7f0-191f1b689a05 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-changed-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-6091d38c-ff6f-48d6-9f9d-d008cff669e3 req-a76defea-636b-4c7b-a7f0-191f1b689a05 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Refreshing instance network info cache due to event network-changed-7026c22f-40fe-4665-9fb8-5d116dfe7513. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6091d38c-ff6f-48d6-9f9d-d008cff669e3 req-a76defea-636b-4c7b-a7f0-191f1b689a05 service nova] Acquiring lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Releasing lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance network_info: |[{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6091d38c-ff6f-48d6-9f9d-d008cff669e3 req-a76defea-636b-4c7b-a7f0-191f1b689a05 service nova] Acquired lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.neutron [req-6091d38c-ff6f-48d6-9f9d-d008cff669e3 req-a76defea-636b-4c7b-a7f0-191f1b689a05 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Refreshing network info cache for port 7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Start _get_guest_xml network_info=[{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:00:32 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:00:32 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'pci_devices' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:00:32 user nova-compute[72803]:   <uuid>5170f08d-a847-4094-82b7-749797acf8b7</uuid>
Aug 15 07:00:32 user nova-compute[72803]:   <name>instance-00000012</name>
Aug 15 07:00:32 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:00:32 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:00:32 user nova-compute[72803]:   <metadata>
Aug 15 07:00:32 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:00:32 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:00:32 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeTestJSON-server-1872031898</nova:name>
Aug 15 07:00:32 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:00:32</nova:creationTime>
Aug 15 07:00:32 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:00:32 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:00:32 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:00:32 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:00:32 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:00:32 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:00:32 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:00:32 user nova-compute[72803]:       <nova:owner>
Aug 15 07:00:32 user nova-compute[72803]:         <nova:user uuid="aeef867bec97404e9bd1f9810b93ba29">tempest-AttachVolumeTestJSON-820469847-project-member</nova:user>
Aug 15 07:00:32 user nova-compute[72803]:         <nova:project uuid="faa20f14f0f14b6791cce17d3fec420d">tempest-AttachVolumeTestJSON-820469847</nova:project>
Aug 15 07:00:32 user nova-compute[72803]:       </nova:owner>
Aug 15 07:00:32 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:00:32 user nova-compute[72803]:       <nova:ports>
Aug 15 07:00:32 user nova-compute[72803]:         <nova:port uuid="7026c22f-40fe-4665-9fb8-5d116dfe7513">
Aug 15 07:00:32 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 07:00:32 user nova-compute[72803]:         </nova:port>
Aug 15 07:00:32 user nova-compute[72803]:       </nova:ports>
Aug 15 07:00:32 user nova-compute[72803]:     </nova:instance>
Aug 15 07:00:32 user nova-compute[72803]:   </metadata>
Aug 15 07:00:32 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:00:32 user nova-compute[72803]:     <system>
Aug 15 07:00:32 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:00:32 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:00:32 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:00:32 user nova-compute[72803]:       <entry name="serial">5170f08d-a847-4094-82b7-749797acf8b7</entry>
Aug 15 07:00:32 user nova-compute[72803]:       <entry name="uuid">5170f08d-a847-4094-82b7-749797acf8b7</entry>
Aug 15 07:00:32 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:00:32 user nova-compute[72803]:     </system>
Aug 15 07:00:32 user nova-compute[72803]:   </sysinfo>
Aug 15 07:00:32 user nova-compute[72803]:   <os>
Aug 15 07:00:32 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:00:32 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:00:32 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:00:32 user nova-compute[72803]:   </os>
Aug 15 07:00:32 user nova-compute[72803]:   <features>
Aug 15 07:00:32 user nova-compute[72803]:     <acpi/>
Aug 15 07:00:32 user nova-compute[72803]:     <apic/>
Aug 15 07:00:32 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:00:32 user nova-compute[72803]:   </features>
Aug 15 07:00:32 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:00:32 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:00:32 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:00:32 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:00:32 user nova-compute[72803]:   </clock>
Aug 15 07:00:32 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:00:32 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:00:32 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:00:32 user nova-compute[72803]:   </cpu>
Aug 15 07:00:32 user nova-compute[72803]:   <devices>
Aug 15 07:00:32 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:00:32 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:00:32 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk"/>
Aug 15 07:00:32 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:00:32 user nova-compute[72803]:     </disk>
Aug 15 07:00:32 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:00:32 user nova-compute[72803]:       <mac address="fa:16:3e:b8:f9:8b"/>
Aug 15 07:00:32 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:00:32 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:00:32 user nova-compute[72803]:       <target dev="tap7026c22f-40"/>
Aug 15 07:00:32 user nova-compute[72803]:     </interface>
Aug 15 07:00:32 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:00:32 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/console.log" append="off"/>
Aug 15 07:00:32 user nova-compute[72803]:     </serial>
Aug 15 07:00:32 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:00:32 user nova-compute[72803]:     <video>
Aug 15 07:00:32 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:00:32 user nova-compute[72803]:     </video>
Aug 15 07:00:32 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:00:32 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:00:32 user nova-compute[72803]:     </rng>
Aug 15 07:00:32 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:00:32 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:00:32 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:00:32 user nova-compute[72803]:     </memballoon>
Aug 15 07:00:32 user nova-compute[72803]:   </devices>
Aug 15 07:00:32 user nova-compute[72803]: </domain>
Aug 15 07:00:32 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:00:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG os_vif [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7026c22f-40, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7026c22f-40, col_values=(('external_ids', {'iface-id': '7026c22f-40fe-4665-9fb8-5d116dfe7513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:f9:8b', 'vm-uuid': '5170f08d-a847-4094-82b7-749797acf8b7'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:32 user nova-compute[72803]: INFO os_vif [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40')
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:00:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No VIF found with MAC fa:16:3e:b8:f9:8b, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG nova.network.neutron [req-6091d38c-ff6f-48d6-9f9d-d008cff669e3 req-a76defea-636b-4c7b-a7f0-191f1b689a05 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updated VIF entry in instance network info cache for port 7026c22f-40fe-4665-9fb8-5d116dfe7513. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG nova.network.neutron [req-6091d38c-ff6f-48d6-9f9d-d008cff669e3 req-a76defea-636b-4c7b-a7f0-191f1b689a05 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6091d38c-ff6f-48d6-9f9d-d008cff669e3 req-a76defea-636b-4c7b-a7f0-191f1b689a05 service nova] Releasing lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue --force-share --output=json" returned: 0 in 0.284s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue --force-share --output=json" returned: 0 in 0.272s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-60403030-37a4-4b09-9b8c-538cb1d8de3b req-4621d7cb-0732-4834-a466-25955b4a52d8 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-60403030-37a4-4b09-9b8c-538cb1d8de3b req-4621d7cb-0732-4834-a466-25955b4a52d8 service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-60403030-37a4-4b09-9b8c-538cb1d8de3b req-4621d7cb-0732-4834-a466-25955b4a52d8 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-60403030-37a4-4b09-9b8c-538cb1d8de3b req-4621d7cb-0732-4834-a466-25955b4a52d8 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-60403030-37a4-4b09-9b8c-538cb1d8de3b req-4621d7cb-0732-4834-a466-25955b4a52d8 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:00:34 user nova-compute[72803]: WARNING nova.compute.manager [req-60403030-37a4-4b09-9b8c-538cb1d8de3b req-4621d7cb-0732-4834-a466-25955b4a52d8 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state building and task_state spawning.
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG nova.compute.manager [req-207c881e-261d-47d6-bd94-c0fc06bb2a27 req-83ccffc6-d9e9-42fd-87e6-7e167ac2ca4d service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-207c881e-261d-47d6-bd94-c0fc06bb2a27 req-83ccffc6-d9e9-42fd-87e6-7e167ac2ca4d service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-207c881e-261d-47d6-bd94-c0fc06bb2a27 req-83ccffc6-d9e9-42fd-87e6-7e167ac2ca4d service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-207c881e-261d-47d6-bd94-c0fc06bb2a27 req-83ccffc6-d9e9-42fd-87e6-7e167ac2ca4d service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG nova.compute.manager [req-207c881e-261d-47d6-bd94-c0fc06bb2a27 req-83ccffc6-d9e9-42fd-87e6-7e167ac2ca4d service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:00:36 user nova-compute[72803]: WARNING nova.compute.manager [req-207c881e-261d-47d6-bd94-c0fc06bb2a27 req-83ccffc6-d9e9-42fd-87e6-7e167ac2ca4d service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state building and task_state spawning.
Aug 15 07:00:36 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082836.9858735, 5170f08d-a847-4094-82b7-749797acf8b7 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:00:36 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Resumed (Lifecycle Event)
Aug 15 07:00:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:00:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:00:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance spawned successfully.
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:00:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082836.9862957, 5170f08d-a847-4094-82b7-749797acf8b7 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:00:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Started (Lifecycle Event)
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:00:37 user nova-compute[72803]: INFO nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Took 7.39 seconds to spawn the instance on the hypervisor.
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:00:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:00:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7086MB free_disk=25.49117660522461GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:00:37 user nova-compute[72803]: INFO nova.compute.manager [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Took 8.43 seconds to build instance.
Aug 15 07:00:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e58f8fc-afee-4c3f-9c92-816cdd58d7e4 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.544s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ff252c72-caf0-4c90-b078-6aab5a0b1fab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f015c02e-e530-4ec9-9fac-6efad4535956 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance d3ad37b6-a585-4e6f-8164-3b726b486412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 06a22c66-fe35-4c52-aef9-9801f38d2832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 454ea345-aaa5-423b-add3-20a933978eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 16812ff4-f16a-483b-8614-6d7a3efc4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:00:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:38 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:00:38 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:00:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:00:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:40 user nova-compute[72803]: INFO nova.compute.manager [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Detaching volume 7339a01d-8222-4c04-ba6e-4634c6bfbdca
Aug 15 07:00:41 user nova-compute[72803]: INFO nova.virt.block_device [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Attempting to driver detach volume 7339a01d-8222-4c04-ba6e-4634c6bfbdca from mountpoint /dev/vdb
Aug 15 07:00:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Attempting to detach device vdb from instance ff252c72-caf0-4c90-b078-6aab5a0b1fab from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:00:41 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:00:41 user nova-compute[72803]:   <source dev="/dev/sdh"/>
Aug 15 07:00:41 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:00:41 user nova-compute[72803]:   <serial>7339a01d-8222-4c04-ba6e-4634c6bfbdca</serial>
Aug 15 07:00:41 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:00:41 user nova-compute[72803]: </disk>
Aug 15 07:00:41 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:00:41 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully detached device vdb from instance ff252c72-caf0-4c90-b078-6aab5a0b1fab from the persistent domain config.
Aug 15 07:00:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff252c72-caf0-4c90-b078-6aab5a0b1fab from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:00:41 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:00:41 user nova-compute[72803]:   <source dev="/dev/sdh"/>
Aug 15 07:00:41 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:00:41 user nova-compute[72803]:   <serial>7339a01d-8222-4c04-ba6e-4634c6bfbdca</serial>
Aug 15 07:00:41 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:00:41 user nova-compute[72803]: </disk>
Aug 15 07:00:41 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692082841.6344795, ff252c72-caf0-4c90-b078-6aab5a0b1fab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff252c72-caf0-4c90-b078-6aab5a0b1fab {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:00:41 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully detached device vdb from instance ff252c72-caf0-4c90-b078-6aab5a0b1fab from the live domain config.
Aug 15 07:00:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hslLRqNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:00:41 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c76391-6a60-4d47-81f9-aa018d994f9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db3c923-7a4d-4bef-b6b4-1064afa52a94]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:00:41 user nova-compute[72803]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)
Aug 15 07:00:41 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 07:00:41 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:00:41 user nova-compute[72803]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)
Aug 15 07:00:41 user nova-compute[72803]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca (non-flash)
Aug 15 07:00:41 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0626b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca'): ({'sdh'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Removing single pathed devices sdh {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba628564-14f1-4055-917d-3355e6bae4f1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4888aabd-2ab0-4c60-b2f0-7f6981d47d9b]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flushing IO for device /dev/sdh {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6071e790-9281-496c-b914-067f321bc04a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.056s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafa0fc0-a62b-488a-b8a3-35a8101ba977]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] SCSI volumes sdh have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7afabe-d602-4d6e-afd0-126797db0282]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bdb644-f409-496f-9d1d-f629b2a5ad82]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca, portal: 172.16.0.220,3260]
Aug 15 07:00:41 user nova-compute[72803]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca, portal: 172.16.0.220,3260] successful.
Aug 15 07:00:41 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7339a01d-8222-4c04-ba6e-4634c6bfbdca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b656fd5-9dc3-4dbe-8689-1856db0086d8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== disconnect_volume: return (332ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:00:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:00:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:42 user nova-compute[72803]: DEBUG nova.objects.instance [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid ff252c72-caf0-4c90-b078-6aab5a0b1fab {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ec02ce58-91ec-4615-94e5-cc6c66f0e83d tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:46 user nova-compute[72803]: INFO nova.compute.manager [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Terminating instance
Aug 15 07:00:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-6adfd570-ea6d-4fef-98f9-50bcd8bd0dd3 req-1d04e6a9-1409-466a-b2e7-7289d0deef0a service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received event network-vif-unplugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6adfd570-ea6d-4fef-98f9-50bcd8bd0dd3 req-1d04e6a9-1409-466a-b2e7-7289d0deef0a service nova] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6adfd570-ea6d-4fef-98f9-50bcd8bd0dd3 req-1d04e6a9-1409-466a-b2e7-7289d0deef0a service nova] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6adfd570-ea6d-4fef-98f9-50bcd8bd0dd3 req-1d04e6a9-1409-466a-b2e7-7289d0deef0a service nova] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-6adfd570-ea6d-4fef-98f9-50bcd8bd0dd3 req-1d04e6a9-1409-466a-b2e7-7289d0deef0a service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] No waiting events found dispatching network-vif-unplugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:00:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-6adfd570-ea6d-4fef-98f9-50bcd8bd0dd3 req-1d04e6a9-1409-466a-b2e7-7289d0deef0a service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received event network-vif-unplugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:00:47 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Instance destroyed successfully.
Aug 15 07:00:47 user nova-compute[72803]: DEBUG nova.objects.instance [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lazy-loading 'resources' on Instance uuid 5fb89ce0-1cc3-4a6a-b812-c889f302584e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410094081',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1410094081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1410094',id=12,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7QWh4EhPR7g5HQz2bjRHymmrXr02AZUNfuDs+w2WYhc1mMECA/XmBMYTNz1FepsCJU480SnoC/6BjLSNynN+hV9BDFo4KY6p5z3InuHXgl9XMDM0/UIsASdA+XLAaxmw==',key_name='tempest-keypair-1835645749',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbc1dffbf0c34ee7bdf7709deb144a46',ramdisk_id='',reservation_id='r-2ojuy0t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-929362686',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f4e9b6b9aee48bea69d3e9deec0c6d8',uuid=5fb89ce0-1cc3-4a6a-b812-c889f302584e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Converting VIF {"id": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "address": "fa:16:3e:8e:16:40", "network": {"id": "5bc0a579-69ef-4495-a71a-c9bdd0c40777", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1250267699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbc1dffbf0c34ee7bdf7709deb144a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20ffd8c7-29", "ovs_interfaceid": "20ffd8c7-29f1-458c-b57b-fdf407ba0446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=20ffd8c7-29f1-458c-b57b-fdf407ba0446,network=Network(5bc0a579-69ef-4495-a71a-c9bdd0c40777),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ffd8c7-29') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG os_vif [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=20ffd8c7-29f1-458c-b57b-fdf407ba0446,network=Network(5bc0a579-69ef-4495-a71a-c9bdd0c40777),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ffd8c7-29') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20ffd8c7-29, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:47 user nova-compute[72803]: INFO os_vif [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:16:40,bridge_name='br-int',has_traffic_filtering=True,id=20ffd8c7-29f1-458c-b57b-fdf407ba0446,network=Network(5bc0a579-69ef-4495-a71a-c9bdd0c40777),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20ffd8c7-29')
Aug 15 07:00:47 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Deleting instance files /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e_del
Aug 15 07:00:47 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Deletion of /opt/stack/data/nova/instances/5fb89ce0-1cc3-4a6a-b812-c889f302584e_del complete
Aug 15 07:00:47 user nova-compute[72803]: INFO nova.compute.manager [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 07:00:47 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:00:47 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:00:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-62eba52a-80dd-4dfb-9da5-6ab2d9f57bfd req-ab97dbbe-46f1-453e-9558-921cea0450c2 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received event network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-62eba52a-80dd-4dfb-9da5-6ab2d9f57bfd req-ab97dbbe-46f1-453e-9558-921cea0450c2 service nova] Acquiring lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-62eba52a-80dd-4dfb-9da5-6ab2d9f57bfd req-ab97dbbe-46f1-453e-9558-921cea0450c2 service nova] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-62eba52a-80dd-4dfb-9da5-6ab2d9f57bfd req-ab97dbbe-46f1-453e-9558-921cea0450c2 service nova] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-62eba52a-80dd-4dfb-9da5-6ab2d9f57bfd req-ab97dbbe-46f1-453e-9558-921cea0450c2 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] No waiting events found dispatching network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:00:48 user nova-compute[72803]: WARNING nova.compute.manager [req-62eba52a-80dd-4dfb-9da5-6ab2d9f57bfd req-ab97dbbe-46f1-453e-9558-921cea0450c2 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received unexpected event network-vif-plugged-20ffd8c7-29f1-458c-b57b-fdf407ba0446 for instance with vm_state active and task_state deleting.
Aug 15 07:00:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:48 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:00:48 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Took 1.66 seconds to deallocate network for instance.
Aug 15 07:00:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:00:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:00:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-4436de11-136c-45c0-a594-5b2435fc6693 req-9cee61e5-1dcc-4b93-b8cd-49e52472d231 service nova] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Received event network-vif-deleted-20ffd8c7-29f1-458c-b57b-fdf407ba0446 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:00:49 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:00:49 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:00:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:49 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Deleted allocations for instance 5fb89ce0-1cc3-4a6a-b812-c889f302584e
Aug 15 07:00:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ed33c373-1322-4023-9967-d33c54c11139 tempest-TestServerVolumeAttachScenarioOldVersion-929362686 tempest-TestServerVolumeAttachScenarioOldVersion-929362686-project-member] Lock "5fb89ce0-1cc3-4a6a-b812-c889f302584e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.320s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:00:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:00:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:02 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082847.140803, 5fb89ce0-1cc3-4a6a-b812-c889f302584e => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:01:02 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] VM Stopped (Lifecycle Event)
Aug 15 07:01:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e9168096-ed91-4e2e-ade0-d94c9a3e33bc None None] [instance: 5fb89ce0-1cc3-4a6a-b812-c889f302584e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "d3ad37b6-a585-4e6f-8164-3b726b486412" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:07 user nova-compute[72803]: INFO nova.compute.manager [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Terminating instance
Aug 15 07:01:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:01:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb2a25e7-8a60-438e-ade0-43e82a878500 req-a74922ee-9d1b-4f4e-941c-d97ad4bb984d service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received event network-vif-unplugged-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb2a25e7-8a60-438e-ade0-43e82a878500 req-a74922ee-9d1b-4f4e-941c-d97ad4bb984d service nova] Acquiring lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb2a25e7-8a60-438e-ade0-43e82a878500 req-a74922ee-9d1b-4f4e-941c-d97ad4bb984d service nova] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb2a25e7-8a60-438e-ade0-43e82a878500 req-a74922ee-9d1b-4f4e-941c-d97ad4bb984d service nova] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb2a25e7-8a60-438e-ade0-43e82a878500 req-a74922ee-9d1b-4f4e-941c-d97ad4bb984d service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] No waiting events found dispatching network-vif-unplugged-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb2a25e7-8a60-438e-ade0-43e82a878500 req-a74922ee-9d1b-4f4e-941c-d97ad4bb984d service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received event network-vif-unplugged-91bf85aa-da25-4b11-b362-487fb905c425 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:08 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Instance destroyed successfully.
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.objects.instance [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'resources' on Instance uuid d3ad37b6-a585-4e6f-8164-3b726b486412 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-738900610',display_name='tempest-VolumesAdminNegativeTest-server-738900610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-738900610',id=15,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:59:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1922e1157f794f3e8eee8df93e0a6276',ramdisk_id='',reservation_id='r-05maoiaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1805149867',owner_user_name='tempest-VolumesAdminNegativeTest-1805149867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:59:13Z,user_data=None,user_id='e992a5e7525e41249ddd5e6fbf1cd24c',uuid=d3ad37b6-a585-4e6f-8164-3b726b486412,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converting VIF {"id": "91bf85aa-da25-4b11-b362-487fb905c425", "address": "fa:16:3e:10:1c:96", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91bf85aa-da", "ovs_interfaceid": "91bf85aa-da25-4b11-b362-487fb905c425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:96,bridge_name='br-int',has_traffic_filtering=True,id=91bf85aa-da25-4b11-b362-487fb905c425,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bf85aa-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG os_vif [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:96,bridge_name='br-int',has_traffic_filtering=True,id=91bf85aa-da25-4b11-b362-487fb905c425,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bf85aa-da') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91bf85aa-da, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:08 user nova-compute[72803]: INFO os_vif [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1c:96,bridge_name='br-int',has_traffic_filtering=True,id=91bf85aa-da25-4b11-b362-487fb905c425,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91bf85aa-da')
Aug 15 07:01:08 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Deleting instance files /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412_del
Aug 15 07:01:08 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Deletion of /opt/stack/data/nova/instances/d3ad37b6-a585-4e6f-8164-3b726b486412_del complete
Aug 15 07:01:08 user nova-compute[72803]: INFO nova.compute.manager [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 15 07:01:08 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:01:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:09 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:01:09 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Took 0.60 seconds to deallocate network for instance.
Aug 15 07:01:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:09 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:01:09 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:01:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:09 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Deleted allocations for instance d3ad37b6-a585-4e6f-8164-3b726b486412
Aug 15 07:01:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ba20d9e9-b7ef-4225-a233-d380ace16081 tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.157s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab2a0c1e-99aa-460c-9cf5-9fba87e05d77 req-b86870ce-2abb-455b-a625-395dabf17a3b service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received event network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab2a0c1e-99aa-460c-9cf5-9fba87e05d77 req-b86870ce-2abb-455b-a625-395dabf17a3b service nova] Acquiring lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab2a0c1e-99aa-460c-9cf5-9fba87e05d77 req-b86870ce-2abb-455b-a625-395dabf17a3b service nova] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab2a0c1e-99aa-460c-9cf5-9fba87e05d77 req-b86870ce-2abb-455b-a625-395dabf17a3b service nova] Lock "d3ad37b6-a585-4e6f-8164-3b726b486412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab2a0c1e-99aa-460c-9cf5-9fba87e05d77 req-b86870ce-2abb-455b-a625-395dabf17a3b service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] No waiting events found dispatching network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:10 user nova-compute[72803]: WARNING nova.compute.manager [req-ab2a0c1e-99aa-460c-9cf5-9fba87e05d77 req-b86870ce-2abb-455b-a625-395dabf17a3b service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received unexpected event network-vif-plugged-91bf85aa-da25-4b11-b362-487fb905c425 for instance with vm_state deleted and task_state None.
Aug 15 07:01:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab2a0c1e-99aa-460c-9cf5-9fba87e05d77 req-b86870ce-2abb-455b-a625-395dabf17a3b service nova] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Received event network-vif-deleted-91bf85aa-da25-4b11-b362-487fb905c425 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-c99dd37d-ea64-4201-8abb-b41cbdc0d5c9 req-ee653b50-9673-427f-b3b2-618f0ac5a09f service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-changed-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-c99dd37d-ea64-4201-8abb-b41cbdc0d5c9 req-ee653b50-9673-427f-b3b2-618f0ac5a09f service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Refreshing instance network info cache due to event network-changed-b3c670dd-02a1-4d2c-867a-450884798f63. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:01:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c99dd37d-ea64-4201-8abb-b41cbdc0d5c9 req-ee653b50-9673-427f-b3b2-618f0ac5a09f service nova] Acquiring lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:01:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c99dd37d-ea64-4201-8abb-b41cbdc0d5c9 req-ee653b50-9673-427f-b3b2-618f0ac5a09f service nova] Acquired lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:01:17 user nova-compute[72803]: DEBUG nova.network.neutron [req-c99dd37d-ea64-4201-8abb-b41cbdc0d5c9 req-ee653b50-9673-427f-b3b2-618f0ac5a09f service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Refreshing network info cache for port b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG nova.network.neutron [req-c99dd37d-ea64-4201-8abb-b41cbdc0d5c9 req-ee653b50-9673-427f-b3b2-618f0ac5a09f service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Updated VIF entry in instance network info cache for port b3c670dd-02a1-4d2c-867a-450884798f63. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG nova.network.neutron [req-c99dd37d-ea64-4201-8abb-b41cbdc0d5c9 req-ee653b50-9673-427f-b3b2-618f0ac5a09f service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Updating instance_info_cache with network_info: [{"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'flavor' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c99dd37d-ea64-4201-8abb-b41cbdc0d5c9 req-ee653b50-9673-427f-b3b2-618f0ac5a09f service nova] Releasing lock "refresh_cache-06a22c66-fe35-4c52-aef9-9801f38d2832" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.190s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:18 user nova-compute[72803]: INFO nova.compute.manager [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Detaching volume c5491415-5196-4845-b334-b4b31baadcac
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:18 user nova-compute[72803]: INFO nova.compute.manager [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Attaching volume 2a7c447c-91dc-45d2-b672-c916022fedd2 to /dev/vdb
Aug 15 07:01:18 user nova-compute[72803]: INFO nova.virt.block_device [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Attempting to driver detach volume c5491415-5196-4845-b334-b4b31baadcac from mountpoint /dev/vdc
Aug 15 07:01:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Attempting to detach device vdc from instance 454ea345-aaa5-423b-add3-20a933978eec from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:01:18 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:01:18 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:01:18 user nova-compute[72803]:   <target dev="vdc" bus="virtio"/>
Aug 15 07:01:18 user nova-compute[72803]:   <serial>c5491415-5196-4845-b334-b4b31baadcac</serial>
Aug 15 07:01:18 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 07:01:18 user nova-compute[72803]: </disk>
Aug 15 07:01:18 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:01:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully detached device vdc from instance 454ea345-aaa5-423b-add3-20a933978eec from the persistent domain config.
Aug 15 07:01:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 454ea345-aaa5-423b-add3-20a933978eec from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:01:18 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:01:18 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:01:18 user nova-compute[72803]:   <target dev="vdc" bus="virtio"/>
Aug 15 07:01:18 user nova-compute[72803]:   <serial>c5491415-5196-4845-b334-b4b31baadcac</serial>
Aug 15 07:01:18 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 07:01:18 user nova-compute[72803]: </disk>
Aug 15 07:01:18 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG os_brick.utils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a6152-dae8-4256-8e88-1138fd62d365]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab2562e-c4e3-4e90-82d2-80dfdd0183a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8585767e-b69f-4d6a-ae9a-52e3b072ad8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fb04fd-736b-487e-87de-cccaf2821811]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:01:19 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b02c32-c483-4025-a97c-0e481a05c2db]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.utils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Updating existing volume attachment record: e7805fc8-11ec-490e-bec3-b677a4329d02 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692082879.3052058, 454ea345-aaa5-423b-add3-20a933978eec => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:01:19 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully detached device vdc from instance 454ea345-aaa5-423b-add3-20a933978eec from the live domain config.
Aug 15 07:01:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyOgYVtE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:19 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2c2554-684a-4272-b9d1-969823111bb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b4c741-fdc5-466f-a8dc-7003ab305cc7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:19 user nova-compute[72803]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)
Aug 15 07:01:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:19 user nova-compute[72803]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac (non-flash)
Aug 15 07:01:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0627490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed36588-4f63-4106-937a-63c9dd87504e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fa1eaf-9c91-4e59-af08-80695b7ea36e]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c754f-90db-44c9-988d-eacedc3b575b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9b1867-e5a1-4e20-a196-d56b9b9681b1]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee435b7c-36d1-46ee-b323-4bc06fb104a1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cbc72b-e229-4dcb-9d3c-fbf36c0dd2c0]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac, portal: 172.16.0.220,3260]
Aug 15 07:01:19 user nova-compute[72803]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac, portal: 172.16.0.220,3260] successful.
Aug 15 07:01:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5491415-5196-4845-b334-b4b31baadcac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f5e4b6-7d7b-44d6-951e-0902a6e1dc07]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] <== disconnect_volume: return (274ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:01:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'flavor' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0e5f0a68-fce9-425f-9b90-edb8a52396a5 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.917s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:21 user nova-compute[72803]: INFO nova.compute.manager [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Terminating instance
Aug 15 07:01:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-60dbd782-1e1f-420d-9557-93c74dcc90dc req-1d13c5d7-868b-4590-a57c-6b33c0d86b31 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-unplugged-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-60dbd782-1e1f-420d-9557-93c74dcc90dc req-1d13c5d7-868b-4590-a57c-6b33c0d86b31 service nova] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-60dbd782-1e1f-420d-9557-93c74dcc90dc req-1d13c5d7-868b-4590-a57c-6b33c0d86b31 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-60dbd782-1e1f-420d-9557-93c74dcc90dc req-1d13c5d7-868b-4590-a57c-6b33c0d86b31 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-60dbd782-1e1f-420d-9557-93c74dcc90dc req-1d13c5d7-868b-4590-a57c-6b33c0d86b31 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] No waiting events found dispatching network-vif-unplugged-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-60dbd782-1e1f-420d-9557-93c74dcc90dc req-1d13c5d7-868b-4590-a57c-6b33c0d86b31 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-unplugged-416da12a-d56b-4d09-bc66-5b4a195a07bd for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-7cda6dac-b7c0-42f0-bc27-5c15c05ecfc9 req-4a654b45-17e0-454c-852f-10e0f4641d37 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-unplugged-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7cda6dac-b7c0-42f0-bc27-5c15c05ecfc9 req-4a654b45-17e0-454c-852f-10e0f4641d37 service nova] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7cda6dac-b7c0-42f0-bc27-5c15c05ecfc9 req-4a654b45-17e0-454c-852f-10e0f4641d37 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7cda6dac-b7c0-42f0-bc27-5c15c05ecfc9 req-4a654b45-17e0-454c-852f-10e0f4641d37 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-7cda6dac-b7c0-42f0-bc27-5c15c05ecfc9 req-4a654b45-17e0-454c-852f-10e0f4641d37 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] No waiting events found dispatching network-vif-unplugged-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-7cda6dac-b7c0-42f0-bc27-5c15c05ecfc9 req-4a654b45-17e0-454c-852f-10e0f4641d37 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-unplugged-9aba22c3-8980-4950-9867-67a6d68dd566 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:01:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Instance destroyed successfully.
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.objects.instance [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lazy-loading 'resources' on Instance uuid f015c02e-e530-4ec9-9fac-6efad4535956 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-98050795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-98050795',id=8,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPKY+eZFkSlg5JqDkuJvKg+ZJP8v4pk8imXoFKXn2eMzTXRBaJk246PztdgOvZODS5yxBQVbWaWO8rygXkwX90itcuhyLQsmgtG7Ne0MJ4N4m9xqLZzVmYrRsewekfXLw==',key_name='tempest-keypair-1472456205',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f9b2d99c28f48ef8d27cd0ff70877ce',ramdisk_id='',reservation_id='r-grgwpcsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-954480488',owner_user_name='tempest-TaggedAttachmentsTest-954480488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8e6404c768452486b45a430e7946bb',uuid=f015c02e-e530-4ec9-9fac-6efad4535956,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converting VIF {"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:30:af,bridge_name='br-int',has_traffic_filtering=True,id=416da12a-d56b-4d09-bc66-5b4a195a07bd,network=Network(d354373a-522c-4a30-b3d0-0defdbc0c442),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416da12a-d5') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG os_vif [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:30:af,bridge_name='br-int',has_traffic_filtering=True,id=416da12a-d56b-4d09-bc66-5b4a195a07bd,network=Network(d354373a-522c-4a30-b3d0-0defdbc0c442),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416da12a-d5') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap416da12a-d5, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:22 user nova-compute[72803]: INFO os_vif [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:30:af,bridge_name='br-int',has_traffic_filtering=True,id=416da12a-d56b-4d09-bc66-5b4a195a07bd,network=Network(d354373a-522c-4a30-b3d0-0defdbc0c442),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416da12a-d5')
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T06:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-98050795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-98050795',id=8,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPKY+eZFkSlg5JqDkuJvKg+ZJP8v4pk8imXoFKXn2eMzTXRBaJk246PztdgOvZODS5yxBQVbWaWO8rygXkwX90itcuhyLQsmgtG7Ne0MJ4N4m9xqLZzVmYrRsewekfXLw==',key_name='tempest-keypair-1472456205',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f9b2d99c28f48ef8d27cd0ff70877ce',ramdisk_id='',reservation_id='r-grgwpcsd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-954480488',owner_user_name='tempest-TaggedAttachmentsTest-954480488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:56:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8e6404c768452486b45a430e7946bb',uuid=f015c02e-e530-4ec9-9fac-6efad4535956,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aba22c3-8980-4950-9867-67a6d68dd566", "address": "fa:16:3e:42:cc:3d", "network": {"id": "40f090e4-fac8-47c1-a074-ea9325c05f2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307198364", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aba22c3-89", "ovs_interfaceid": "9aba22c3-8980-4950-9867-67a6d68dd566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converting VIF {"id": "9aba22c3-8980-4950-9867-67a6d68dd566", "address": "fa:16:3e:42:cc:3d", "network": {"id": "40f090e4-fac8-47c1-a074-ea9325c05f2d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307198364", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aba22c3-89", "ovs_interfaceid": "9aba22c3-8980-4950-9867-67a6d68dd566", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:cc:3d,bridge_name='br-int',has_traffic_filtering=True,id=9aba22c3-8980-4950-9867-67a6d68dd566,network=Network(40f090e4-fac8-47c1-a074-ea9325c05f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aba22c3-89') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG os_vif [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:cc:3d,bridge_name='br-int',has_traffic_filtering=True,id=9aba22c3-8980-4950-9867-67a6d68dd566,network=Network(40f090e4-fac8-47c1-a074-ea9325c05f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aba22c3-89') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aba22c3-89, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:01:22 user nova-compute[72803]: INFO os_vif [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:cc:3d,bridge_name='br-int',has_traffic_filtering=True,id=9aba22c3-8980-4950-9867-67a6d68dd566,network=Network(40f090e4-fac8-47c1-a074-ea9325c05f2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aba22c3-89')
Aug 15 07:01:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Deleting instance files /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956_del
Aug 15 07:01:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Deletion of /opt/stack/data/nova/instances/f015c02e-e530-4ec9-9fac-6efad4535956_del complete
Aug 15 07:01:22 user nova-compute[72803]: INFO nova.compute.manager [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 15 07:01:22 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:01:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-7eca7bd4-e746-416b-968d-9ee6f0a095c3 req-4e8ccbeb-725d-4c69-b378-b93fb22cc04d service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-deleted-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:23 user nova-compute[72803]: INFO nova.compute.manager [req-7eca7bd4-e746-416b-968d-9ee6f0a095c3 req-4e8ccbeb-725d-4c69-b378-b93fb22cc04d service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Neutron deleted interface 9aba22c3-8980-4950-9867-67a6d68dd566; detaching it from the instance and deleting it from the info cache
Aug 15 07:01:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-7eca7bd4-e746-416b-968d-9ee6f0a095c3 req-4e8ccbeb-725d-4c69-b378-b93fb22cc04d service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updating instance_info_cache with network_info: [{"id": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "address": "fa:16:3e:42:30:af", "network": {"id": "d354373a-522c-4a30-b3d0-0defdbc0c442", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-554499775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f9b2d99c28f48ef8d27cd0ff70877ce", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416da12a-d5", "ovs_interfaceid": "416da12a-d56b-4d09-bc66-5b4a195a07bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:01:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-7eca7bd4-e746-416b-968d-9ee6f0a095c3 req-4e8ccbeb-725d-4c69-b378-b93fb22cc04d service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Detach interface failed, port_id=9aba22c3-8980-4950-9867-67a6d68dd566, reason: Instance f015c02e-e530-4ec9-9fac-6efad4535956 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:01:23 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082868.677496, d3ad37b6-a585-4e6f-8164-3b726b486412 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:01:23 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] VM Stopped (Lifecycle Event)
Aug 15 07:01:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-ae99f8c7-a337-4b1d-80cb-475e44b33e15 req-eee1b8ef-88ef-4dd1-a45a-fa604c89fa57 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ae99f8c7-a337-4b1d-80cb-475e44b33e15 req-eee1b8ef-88ef-4dd1-a45a-fa604c89fa57 service nova] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ae99f8c7-a337-4b1d-80cb-475e44b33e15 req-eee1b8ef-88ef-4dd1-a45a-fa604c89fa57 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ae99f8c7-a337-4b1d-80cb-475e44b33e15 req-eee1b8ef-88ef-4dd1-a45a-fa604c89fa57 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-ae99f8c7-a337-4b1d-80cb-475e44b33e15 req-eee1b8ef-88ef-4dd1-a45a-fa604c89fa57 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] No waiting events found dispatching network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:23 user nova-compute[72803]: WARNING nova.compute.manager [req-ae99f8c7-a337-4b1d-80cb-475e44b33e15 req-eee1b8ef-88ef-4dd1-a45a-fa604c89fa57 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received unexpected event network-vif-plugged-416da12a-d56b-4d09-bc66-5b4a195a07bd for instance with vm_state active and task_state deleting.
Aug 15 07:01:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-177d7fd5-f779-4340-9292-40d5f412a8bc None None] [instance: d3ad37b6-a585-4e6f-8164-3b726b486412] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-1f5fa25e-89e3-4467-aec2-fc574c9ddb90 req-d890d6a9-b398-47d8-9687-4366f9a57d65 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1f5fa25e-89e3-4467-aec2-fc574c9ddb90 req-d890d6a9-b398-47d8-9687-4366f9a57d65 service nova] Acquiring lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1f5fa25e-89e3-4467-aec2-fc574c9ddb90 req-d890d6a9-b398-47d8-9687-4366f9a57d65 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1f5fa25e-89e3-4467-aec2-fc574c9ddb90 req-d890d6a9-b398-47d8-9687-4366f9a57d65 service nova] Lock "f015c02e-e530-4ec9-9fac-6efad4535956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-1f5fa25e-89e3-4467-aec2-fc574c9ddb90 req-d890d6a9-b398-47d8-9687-4366f9a57d65 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] No waiting events found dispatching network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:24 user nova-compute[72803]: WARNING nova.compute.manager [req-1f5fa25e-89e3-4467-aec2-fc574c9ddb90 req-d890d6a9-b398-47d8-9687-4366f9a57d65 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received unexpected event network-vif-plugged-9aba22c3-8980-4950-9867-67a6d68dd566 for instance with vm_state active and task_state deleting.
Aug 15 07:01:24 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:01:24 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Took 2.01 seconds to deallocate network for instance.
Aug 15 07:01:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:01:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:24 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Deleted allocations for instance f015c02e-e530-4ec9-9fac-6efad4535956
Aug 15 07:01:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4e9e7d3c-0490-4b9a-8ee8-503c71e6f10d tempest-TaggedAttachmentsTest-954480488 tempest-TaggedAttachmentsTest-954480488-project-member] Lock "f015c02e-e530-4ec9-9fac-6efad4535956" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.602s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-32f9feff-4446-4afd-9913-b82aa2b78c0b req-20bd784d-f4a7-4d99-81b2-e2ad810337d4 service nova] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Received event network-vif-deleted-416da12a-d56b-4d09-bc66-5b4a195a07bd {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:01:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:01:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYxvRlow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:28 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:28 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:28 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8576e7-c3ac-4f99-b13e-5714ea54e353]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:01:28 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdde6bdd-3f80-42e8-9640-d520e4b41792]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2] added
Aug 15 07:01:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd67b28-86d2-4117-a41e-352fe8d0ba42]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d260e8-1687-4d6f-b2ff-cf06ec70ae1d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYxvRlow {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYxvRlow" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b880a4-049f-4e6c-91cd-c40c83e35b73]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VYxvRlow'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d666463-739a-4a9a-a18b-9b45514e6958]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f4a8f-4d45-411c-8f1c-5b3a1033fb09]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa2cd62-e8bd-43da-9863-5577f067fe1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260]
Aug 15 07:01:29 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260] successful.
Aug 15 07:01:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74ec816-f4e1-492d-bd0b-11a95e1627bd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[17129004-076d-413c-bf1c-3cc89a5c4eee]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:29 user nova-compute[72803]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:01:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:29 user nova-compute[72803]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:01:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d1ee9d-4dd2-4ff7-88eb-f8cc022a49cf]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lazy-loading 'flavor' on Instance uuid 16812ff4-f16a-483b-8614-6d7a3efc4725 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYxvRlow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23236343461333566', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236343461333566', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'flavor' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:01:30 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:01:30 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:01:30 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:01:30 user nova-compute[72803]:   <serial>2a7c447c-91dc-45d2-b672-c916022fedd2</serial>
Aug 15 07:01:30 user nova-compute[72803]: </disk>
Aug 15 07:01:30 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:30 user nova-compute[72803]: INFO nova.compute.manager [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Attaching volume be2cc27d-4d90-4c17-b8b7-99922b568c48 to /dev/vdb
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.utils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a47a3c-4bea-4073-be02-fb7c68a07b20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1224b32a-1296-4c73-b641-b621d91b37be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ccbc0-5fe3-4d91-ad01-a26919dcd874]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebe8d92-f6fb-4769-beea-d7c718aaf1f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:01:30 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[789a40d2-284e-4e60-a616-d5f42bdbeea9]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG os_brick.utils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Updating existing volume attachment record: dd8b1e77-5a63-4725-b09c-781b2a7f3929 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No VIF found with MAC fa:16:3e:96:fd:20, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:01:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbc916f6-aecd-42a8-9f50-762481de3c91 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.944s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:31 user nova-compute[72803]: INFO nova.compute.manager [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Terminating instance
Aug 15 07:01:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-e15e7dba-d538-4d07-9eef-5156680ffa05 req-c2ef5cdf-df5a-4f97-a659-1abb95a40bcc service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received event network-vif-unplugged-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e15e7dba-d538-4d07-9eef-5156680ffa05 req-c2ef5cdf-df5a-4f97-a659-1abb95a40bcc service nova] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e15e7dba-d538-4d07-9eef-5156680ffa05 req-c2ef5cdf-df5a-4f97-a659-1abb95a40bcc service nova] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e15e7dba-d538-4d07-9eef-5156680ffa05 req-c2ef5cdf-df5a-4f97-a659-1abb95a40bcc service nova] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-e15e7dba-d538-4d07-9eef-5156680ffa05 req-c2ef5cdf-df5a-4f97-a659-1abb95a40bcc service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] No waiting events found dispatching network-vif-unplugged-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-e15e7dba-d538-4d07-9eef-5156680ffa05 req-c2ef5cdf-df5a-4f97-a659-1abb95a40bcc service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received event network-vif-unplugged-5248eb08-f20c-4c7e-889e-959facbbc988 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Instance destroyed successfully.
Aug 15 07:01:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'resources' on Instance uuid ff252c72-caf0-4c90-b078-6aab5a0b1fab {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-122733738',display_name='tempest-AttachVolumeNegativeTest-server-122733738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-122733738',id=3,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMU/IpZeRPR3dfkhJ1fJln7PRIyHNDlD5k0XgYt/y2L0Lf18crCbTcIEiBtUvnRbSPpmOg2TQ2tjSdD1Q3jIdsEtGTZyB2BkvZ3o6bJJUiyrz52dySc/onHk1zAZs5kDzA==',key_name='tempest-keypair-1082670762',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:55:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-0kn80jqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=ff252c72-caf0-4c90-b078-6aab5a0b1fab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "5248eb08-f20c-4c7e-889e-959facbbc988", "address": "fa:16:3e:3d:7a:93", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5248eb08-f2", "ovs_interfaceid": "5248eb08-f20c-4c7e-889e-959facbbc988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:7a:93,bridge_name='br-int',has_traffic_filtering=True,id=5248eb08-f20c-4c7e-889e-959facbbc988,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5248eb08-f2') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG os_vif [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:7a:93,bridge_name='br-int',has_traffic_filtering=True,id=5248eb08-f20c-4c7e-889e-959facbbc988,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5248eb08-f2') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5248eb08-f2, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:01:32 user nova-compute[72803]: INFO os_vif [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:7a:93,bridge_name='br-int',has_traffic_filtering=True,id=5248eb08-f20c-4c7e-889e-959facbbc988,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5248eb08-f2')
Aug 15 07:01:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Deleting instance files /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab_del
Aug 15 07:01:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Deletion of /opt/stack/data/nova/instances/ff252c72-caf0-4c90-b078-6aab5a0b1fab_del complete
Aug 15 07:01:32 user nova-compute[72803]: INFO nova.compute.manager [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 07:01:32 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:01:32 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:01:32 user nova-compute[72803]: INFO nova.compute.manager [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Rebuilding instance
Aug 15 07:01:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'trusted_certs' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'pci_requests' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'pci_devices' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'resources' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'migration_context' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72803) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-16214847-2a1b-4058-97d0-26be4bd83b09 req-ed12c540-ae19-4759-8525-0928e88a67e6 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-unplugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16214847-2a1b-4058-97d0-26be4bd83b09 req-ed12c540-ae19-4759-8525-0928e88a67e6 service nova] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16214847-2a1b-4058-97d0-26be4bd83b09 req-ed12c540-ae19-4759-8525-0928e88a67e6 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-16214847-2a1b-4058-97d0-26be4bd83b09 req-ed12c540-ae19-4759-8525-0928e88a67e6 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-16214847-2a1b-4058-97d0-26be4bd83b09 req-ed12c540-ae19-4759-8525-0928e88a67e6 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] No waiting events found dispatching network-vif-unplugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:33 user nova-compute[72803]: WARNING nova.compute.manager [req-16214847-2a1b-4058-97d0-26be4bd83b09 req-ed12c540-ae19-4759-8525-0928e88a67e6 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received unexpected event network-vif-unplugged-b3c670dd-02a1-4d2c-867a-450884798f63 for instance with vm_state active and task_state rebuilding.
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:01:33 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Took 1.62 seconds to deallocate network for instance.
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-0dc9cebc-5d1f-49ff-89b8-262dc07d2a58 req-d6b25632-1a2d-4d8d-94c8-8deca4bd3bfa service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received event network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0dc9cebc-5d1f-49ff-89b8-262dc07d2a58 req-d6b25632-1a2d-4d8d-94c8-8deca4bd3bfa service nova] Acquiring lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0dc9cebc-5d1f-49ff-89b8-262dc07d2a58 req-d6b25632-1a2d-4d8d-94c8-8deca4bd3bfa service nova] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0dc9cebc-5d1f-49ff-89b8-262dc07d2a58 req-d6b25632-1a2d-4d8d-94c8-8deca4bd3bfa service nova] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-0dc9cebc-5d1f-49ff-89b8-262dc07d2a58 req-d6b25632-1a2d-4d8d-94c8-8deca4bd3bfa service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] No waiting events found dispatching network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:33 user nova-compute[72803]: WARNING nova.compute.manager [req-0dc9cebc-5d1f-49ff-89b8-262dc07d2a58 req-d6b25632-1a2d-4d8d-94c8-8deca4bd3bfa service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received unexpected event network-vif-plugged-5248eb08-f20c-4c7e-889e-959facbbc988 for instance with vm_state active and task_state deleting.
Aug 15 07:01:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:33 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance destroyed successfully.
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:01:34 user nova-compute[72803]: INFO nova.compute.manager [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Detaching volume 2a7c447c-91dc-45d2-b672-c916022fedd2
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:01:34 user nova-compute[72803]: INFO nova.virt.block_device [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Attempting to driver detach volume 2a7c447c-91dc-45d2-b672-c916022fedd2 from mountpoint /dev/vdb
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Attempting to detach device vdb from instance 06a22c66-fe35-4c52-aef9-9801f38d2832 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:01:34 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:01:34 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:01:34 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:01:34 user nova-compute[72803]:   <serial>2a7c447c-91dc-45d2-b672-c916022fedd2</serial>
Aug 15 07:01:34 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:01:34 user nova-compute[72803]: </disk>
Aug 15 07:01:34 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:01:34 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully detached device vdb from instance 06a22c66-fe35-4c52-aef9-9801f38d2832 from the persistent domain config.
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYxvRlow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:34 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b2f4a1-7e85-46df-924c-cec187cf3a53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ada4b0-2e10-4bcd-af07-f65500e120b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:34 user nova-compute[72803]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:01:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:34 user nova-compute[72803]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:01:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0684ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d378c-d428-48b8-adfd-c00214f3d105]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[946714e0-2cad-40cd-8555-4d4638ebe065]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ab721-13ba-4318-870d-79ed4d5c0b87]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[162de348-61e9-4afd-86c4-4ef2b8241c32]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e93990-6c20-4e1c-a6e1-affd4e00844d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[784c9396-67ee-4c52-aa9e-011e98e581db]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260]
Aug 15 07:01:34 user nova-compute[72803]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260] successful.
Aug 15 07:01:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[66346138-fd64-40e2-a77a-fb6f176d51bb]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== disconnect_volume: return (317ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.669s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:34 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Deleted allocations for instance ff252c72-caf0-4c90-b078-6aab5a0b1fab
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c80a2e70-0e63-4de4-ac58-e0b30582a6d6 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "ff252c72-caf0-4c90-b078-6aab5a0b1fab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.426s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance destroyed successfully.
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-434501159',display_name='tempest-ServerActionsTestOtherA-server-221183768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-434501159',id=16,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUZ/EwNsA5ruMIw3IDFFAGkJQBK1O6/57tM7BxohUJ7SYDtPC3cHhbHxvpQ+BwkgtdivuuuprwjP+NluswpG70oDt4GOKuJikiDEf0XWiaJ8X18OMWn/ICQApxHaZ4GAQ==',key_name='tempest-keypair-2020809915',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-9c6fhw9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:01:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=06a22c66-fe35-4c52-aef9-9801f38d2832,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_vif [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3c670dd-02, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: INFO os_vif [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02')
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYxvRlow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:35 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c35a3-3c8f-4532-9fb4-c6b20ea08014]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff54a1d-27b4-4c74-9bf6-d87ddb86f358]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:35 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:35 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f350f460550>, {}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Disconnecting from: [] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== disconnect_volume: return (52ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:01:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Deleting instance files /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832_del
Aug 15 07:01:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Deletion of /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832_del complete
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: INFO nova.virt.block_device [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Booting with volume 2a7c447c-91dc-45d2-b672-c916022fedd2 at /dev/vdb
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-0cf85bcc-cf5a-4966-8f7f-e7cc51046a52 req-9c28419e-4e5a-4f69-bdd7-485a3380f3e0 service nova] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Received event network-vif-deleted-5248eb08-f20c-4c7e-889e-959facbbc988 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-0cf85bcc-cf5a-4966-8f7f-e7cc51046a52 req-9c28419e-4e5a-4f69-bdd7-485a3380f3e0 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0cf85bcc-cf5a-4966-8f7f-e7cc51046a52 req-9c28419e-4e5a-4f69-bdd7-485a3380f3e0 service nova] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0cf85bcc-cf5a-4966-8f7f-e7cc51046a52 req-9c28419e-4e5a-4f69-bdd7-485a3380f3e0 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0cf85bcc-cf5a-4966-8f7f-e7cc51046a52 req-9c28419e-4e5a-4f69-bdd7-485a3380f3e0 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-0cf85bcc-cf5a-4966-8f7f-e7cc51046a52 req-9c28419e-4e5a-4f69-bdd7-485a3380f3e0 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] No waiting events found dispatching network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:35 user nova-compute[72803]: WARNING nova.compute.manager [req-0cf85bcc-cf5a-4966-8f7f-e7cc51046a52 req-9c28419e-4e5a-4f69-bdd7-485a3380f3e0 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received unexpected event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 for instance with vm_state active and task_state rebuilding.
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.utils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea405cb-4027-4ebf-b280-ef53942dfcf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c966b7-b005-485d-bc57-7378f0ad472c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a612b87-38f8-40be-8eba-8567419f2448]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f583a5-e9bc-47e8-a553-8845fc287e76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:01:35 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:01:35 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[015d3c6c-61c0-466d-8f1d-262d17817db6]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG os_brick.utils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:35 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Updating existing volume attachment record: 6c14dbe1-cc32-44ce-8365-b8c454a50be2 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:36 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid '06a22c66-fe35-4c52-aef9-9801f38d2832' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid '06a22c66-fe35-4c52-aef9-9801f38d2832' (instance-00000010)
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082882.165548, f015c02e-e530-4ec9-9fac-6efad4535956 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:01:37 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] VM Stopped (Lifecycle Event)
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7c6b9949-ff76-49ec-932c-aece8182bb75 None None] [instance: f015c02e-e530-4ec9-9fac-6efad4535956] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:01:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7552MB free_disk=25.55905532836914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 06a22c66-fe35-4c52-aef9-9801f38d2832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 454ea345-aaa5-423b-add3-20a933978eec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 16812ff4-f16a-483b-8614-6d7a3efc4725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:01:37 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:01:38 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:01:38 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:01:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:01:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZqNVoPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:40 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:40 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:40 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[766ad185-9ae7-465a-9ac2-63d86656b8dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:01:40 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac9e47-640e-46fd-b659-9c4e90e7439b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48] added
Aug 15 07:01:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf9cc86-fde1-4e41-b5e0-3328de15e090]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.052s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e747a4-07f8-47c2-ba82-057e42cdca1c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZqNVoPQ {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZqNVoPQ" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd63358-2fe8-4c1c-89ac-9e3ce5aa570e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DZqNVoPQ'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b600e3-9ea4-458f-9c16-a2b701936fb7]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fef983-1cb4-4360-9a83-d83316bd6185]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a3e596-8f0f-4fa3-9429-694c7127aedd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48, portal: 172.16.0.220,3260]
Aug 15 07:01:40 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48, portal: 172.16.0.220,3260] successful.
Aug 15 07:01:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c5f15-aba8-4c82-a88d-889f2cb1fd7e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca751d93-a8d9-4b17-89aa-29a731452e24]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:40 user nova-compute[72803]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 (non-flash)
Aug 15 07:01:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:40 user nova-compute[72803]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 (non-flash)
Aug 15 07:01:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ded65-c046-46cf-9026-eda5ca08b0ea]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:01:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:41 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:01:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZqNVoPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:01:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23163323230363766', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163323230363766', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:01:41 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lazy-loading 'flavor' on Instance uuid 16812ff4-f16a-483b-8614-6d7a3efc4725 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:01:41 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:01:41 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:01:41 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:01:41 user nova-compute[72803]:   <serial>be2cc27d-4d90-4c17-b8b7-99922b568c48</serial>
Aug 15 07:01:41 user nova-compute[72803]: </disk>
Aug 15 07:01:41 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:01:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:01:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:01:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] No VIF found with MAC fa:16:3e:aa:38:af, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:01:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a7eef764-92ed-4452-82b5-ce72566c88a1 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.321s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:43 user nova-compute[72803]: INFO nova.compute.manager [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Terminating instance
Aug 15 07:01:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:01:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ceb5fa5-67d9-4d24-8fba-7cbe973e8136 req-41a5bcc8-512a-4bc7-bb54-01e45b3ff95c service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received event network-vif-unplugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ceb5fa5-67d9-4d24-8fba-7cbe973e8136 req-41a5bcc8-512a-4bc7-bb54-01e45b3ff95c service nova] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ceb5fa5-67d9-4d24-8fba-7cbe973e8136 req-41a5bcc8-512a-4bc7-bb54-01e45b3ff95c service nova] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9ceb5fa5-67d9-4d24-8fba-7cbe973e8136 req-41a5bcc8-512a-4bc7-bb54-01e45b3ff95c service nova] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ceb5fa5-67d9-4d24-8fba-7cbe973e8136 req-41a5bcc8-512a-4bc7-bb54-01e45b3ff95c service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] No waiting events found dispatching network-vif-unplugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-9ceb5fa5-67d9-4d24-8fba-7cbe973e8136 req-41a5bcc8-512a-4bc7-bb54-01e45b3ff95c service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received event network-vif-unplugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:01:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Instance destroyed successfully.
Aug 15 07:01:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lazy-loading 'resources' on Instance uuid 16812ff4-f16a-483b-8614-6d7a3efc4725 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:59:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1276884057',display_name='tempest-DeleteServersTestJSON-server-1276884057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1276884057',id=17,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850ba4e0e0154650a7f939f83febd354',ramdisk_id='',reservation_id='r-8700zi12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-801555969',owner_user_name='tempest-DeleteServersTestJSON-801555969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:59:44Z,user_data=None,user_id='e8dca50ff83a4745ad4c40f641851b73',uuid=16812ff4-f16a-483b-8614-6d7a3efc4725,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Converting VIF {"id": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "address": "fa:16:3e:aa:38:af", "network": {"id": "53bf6c94-b186-4a32-9940-fe5baf9ffc7d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1486920376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850ba4e0e0154650a7f939f83febd354", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a9844d-6b", "ovs_interfaceid": "f5a9844d-6be0-40d0-b103-f844c6c434a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:af,bridge_name='br-int',has_traffic_filtering=True,id=f5a9844d-6be0-40d0-b103-f844c6c434a7,network=Network(53bf6c94-b186-4a32-9940-fe5baf9ffc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a9844d-6b') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_vif [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:af,bridge_name='br-int',has_traffic_filtering=True,id=f5a9844d-6be0-40d0-b103-f844c6c434a7,network=Network(53bf6c94-b186-4a32-9940-fe5baf9ffc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a9844d-6b') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a9844d-6b, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:44 user nova-compute[72803]: INFO os_vif [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:af,bridge_name='br-int',has_traffic_filtering=True,id=f5a9844d-6be0-40d0-b103-f844c6c434a7,network=Network(53bf6c94-b186-4a32-9940-fe5baf9ffc7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a9844d-6b')
Aug 15 07:01:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZqNVoPQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:44 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90f5675-cce1-485a-99a4-f098ab1e2ea7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443775d-08e3-4787-b7d6-825c450eb971]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:44 user nova-compute[72803]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 (non-flash)
Aug 15 07:01:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:44 user nova-compute[72803]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 (non-flash)
Aug 15 07:01:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c07d8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c41787-3071-4717-8485-d9337f91c1f7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[046fbf10-1159-41e5-81cf-8f748eb74c93]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21956e6-74d1-45ea-b3f7-97a761b8478d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef23c7a-7a46-4a32-af30-20a2eaf5b959]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:01:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10cb53f-ebe1-4488-af47-ef24709529a5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2a57d-43b0-438e-983f-94034564651c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48, portal: 172.16.0.220,3260]
Aug 15 07:01:45 user nova-compute[72803]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48, portal: 172.16.0.220,3260] successful.
Aug 15 07:01:45 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be2cc27d-4d90-4c17-b8b7-99922b568c48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[935801d8-2ffa-49f7-b1e7-7bc1dfd2b76d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] <== disconnect_volume: return (305ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:01:45 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Deleting instance files /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725_del
Aug 15 07:01:45 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Deletion of /opt/stack/data/nova/instances/16812ff4-f16a-483b-8614-6d7a3efc4725_del complete
Aug 15 07:01:45 user nova-compute[72803]: INFO nova.compute.manager [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 15 07:01:45 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:01:45 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:01:46 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Creating image(s)
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-bdebe8c8-9964-4b12-b4bf-d4930985de1f req-be90b75e-5590-48bb-b17c-7129b5fb263e service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received event network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bdebe8c8-9964-4b12-b4bf-d4930985de1f req-be90b75e-5590-48bb-b17c-7129b5fb263e service nova] Acquiring lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bdebe8c8-9964-4b12-b4bf-d4930985de1f req-be90b75e-5590-48bb-b17c-7129b5fb263e service nova] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bdebe8c8-9964-4b12-b4bf-d4930985de1f req-be90b75e-5590-48bb-b17c-7129b5fb263e service nova] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-bdebe8c8-9964-4b12-b4bf-d4930985de1f req-be90b75e-5590-48bb-b17c-7129b5fb263e service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] No waiting events found dispatching network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:46 user nova-compute[72803]: WARNING nova.compute.manager [req-bdebe8c8-9964-4b12-b4bf-d4930985de1f req-be90b75e-5590-48bb-b17c-7129b5fb263e service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received unexpected event network-vif-plugged-f5a9844d-6be0-40d0-b103-f844c6c434a7 for instance with vm_state active and task_state deleting.
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:01:46 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Took 1.46 seconds to deallocate network for instance.
Aug 15 07:01:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-e98ddd2d-7931-434e-943d-76e70d7e5a57 req-9291a1cf-886f-4b54-8b41-20d3ea165b2f service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Received event network-vif-deleted-f5a9844d-6be0-40d0-b103-f844c6c434a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:46 user nova-compute[72803]: INFO nova.compute.manager [req-e98ddd2d-7931-434e-943d-76e70d7e5a57 req-9291a1cf-886f-4b54-8b41-20d3ea165b2f service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Neutron deleted interface f5a9844d-6be0-40d0-b103-f844c6c434a7; detaching it from the instance and deleting it from the info cache
Aug 15 07:01:46 user nova-compute[72803]: DEBUG nova.network.neutron [req-e98ddd2d-7931-434e-943d-76e70d7e5a57 req-9291a1cf-886f-4b54-8b41-20d3ea165b2f service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-e98ddd2d-7931-434e-943d-76e70d7e5a57 req-9291a1cf-886f-4b54-8b41-20d3ea165b2f service nova] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Detach interface failed, port_id=f5a9844d-6be0-40d0-b103-f844c6c434a7, reason: Instance 16812ff4-f16a-483b-8614-6d7a3efc4725 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.223s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk 1073741824" returned: 0 in 0.047s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Cannot resize image /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Ensure instance console log exists: /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Start _get_guest_xml network_info=[{"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '6c14dbe1-cc32-44ce-8365-b8c454a50be2', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYxvRlow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06a22c66-fe35-4c52-aef9-9801f38d2832', 'attached_at': '', 'detached_at': '', 'volume_id': '2a7c447c-91dc-45d2-b672-c916022fedd2', 'serial': '2a7c447c-91dc-45d2-b672-c916022fedd2'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082892.1423876, ff252c72-caf0-4c90-b078-6aab5a0b1fab => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:01:47 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] VM Stopped (Lifecycle Event)
Aug 15 07:01:47 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 07:01:47 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'vcpu_model' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5ccabe42-bbb6-4fb2-8ab0-565f19a21e80 None None] [instance: ff252c72-caf0-4c90-b078-6aab5a0b1fab] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYxvRlow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:01:47 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:47 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:01:47 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c6855e-36f1-466c-b7a5-5f662cc4640c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:01:47 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfedeafe-2aed-4aba-a864-2a847806a4d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2] added
Aug 15 07:01:47 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0d22c1-ef73-4f3a-92de-a7430257fdb4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3d38de-f5dc-4d56-8c69-a42e5b1bfe91]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYxvRlow {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYxvRlow" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7b279-d0f7-4a0c-b0bc-53d7aea18bd4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VYxvRlow'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[020cd36a-4a33-4946-b860-1816cfec7d94]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7cca15-b910-431a-879e-3185957fef43]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:47 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:47 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: INFO nova.compute.manager [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Took 0.84 seconds to detach 1 volumes for instance.
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cd1441-8cc5-4f20-8e2b-d48b8edc214d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260]
Aug 15 07:01:47 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260] successful.
Aug 15 07:01:47 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9de1aa-c5b3-4cf1-8167-a5206fe7e293]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c755dc3e-69cd-414d-9df1-043aa04c7c20]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:47 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:01:47 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:01:47 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:01:47 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99603d1-5729-4ddd-80bc-ad71c8aefd09]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYxvRlow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:01:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:47 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Deleted allocations for instance 16812ff4-f16a-483b-8614-6d7a3efc4725
Aug 15 07:01:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20ce0c4a-fb7f-4394-b34b-85e30efc2bc2 tempest-DeleteServersTestJSON-801555969 tempest-DeleteServersTestJSON-801555969-project-member] Lock "16812ff4-f16a-483b-8614-6d7a3efc4725" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.129s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23236343461333566', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236343461333566', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T06:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-434501159',display_name='tempest-ServerActionsTestOtherA-server-221183768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-434501159',id=16,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUZ/EwNsA5ruMIw3IDFFAGkJQBK1O6/57tM7BxohUJ7SYDtPC3cHhbHxvpQ+BwkgtdivuuuprwjP+NluswpG70oDt4GOKuJikiDEf0XWiaJ8X18OMWn/ICQApxHaZ4GAQ==',key_name='tempest-keypair-2020809915',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-9c6fhw9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:01:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=06a22c66-fe35-4c52-aef9-9801f38d2832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:01:48 user nova-compute[72803]:   <uuid>06a22c66-fe35-4c52-aef9-9801f38d2832</uuid>
Aug 15 07:01:48 user nova-compute[72803]:   <name>instance-00000010</name>
Aug 15 07:01:48 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:01:48 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:01:48 user nova-compute[72803]:   <metadata>
Aug 15 07:01:48 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:01:48 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:01:48 user nova-compute[72803]:       <nova:name>tempest-ServerActionsTestOtherA-server-221183768</nova:name>
Aug 15 07:01:48 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:01:47</nova:creationTime>
Aug 15 07:01:48 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:01:48 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:01:48 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:01:48 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:01:48 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:01:48 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:01:48 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:01:48 user nova-compute[72803]:       <nova:owner>
Aug 15 07:01:48 user nova-compute[72803]:         <nova:user uuid="f1e4fd69d1a64b8d80b0d1a45d62190f">tempest-ServerActionsTestOtherA-931999183-project-member</nova:user>
Aug 15 07:01:48 user nova-compute[72803]:         <nova:project uuid="ecaf763674bc4aaca9e52eda0cf41f44">tempest-ServerActionsTestOtherA-931999183</nova:project>
Aug 15 07:01:48 user nova-compute[72803]:       </nova:owner>
Aug 15 07:01:48 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:01:48 user nova-compute[72803]:       <nova:ports>
Aug 15 07:01:48 user nova-compute[72803]:         <nova:port uuid="b3c670dd-02a1-4d2c-867a-450884798f63">
Aug 15 07:01:48 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 07:01:48 user nova-compute[72803]:         </nova:port>
Aug 15 07:01:48 user nova-compute[72803]:       </nova:ports>
Aug 15 07:01:48 user nova-compute[72803]:     </nova:instance>
Aug 15 07:01:48 user nova-compute[72803]:   </metadata>
Aug 15 07:01:48 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:01:48 user nova-compute[72803]:     <system>
Aug 15 07:01:48 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:01:48 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:01:48 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:01:48 user nova-compute[72803]:       <entry name="serial">06a22c66-fe35-4c52-aef9-9801f38d2832</entry>
Aug 15 07:01:48 user nova-compute[72803]:       <entry name="uuid">06a22c66-fe35-4c52-aef9-9801f38d2832</entry>
Aug 15 07:01:48 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:01:48 user nova-compute[72803]:     </system>
Aug 15 07:01:48 user nova-compute[72803]:   </sysinfo>
Aug 15 07:01:48 user nova-compute[72803]:   <os>
Aug 15 07:01:48 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:01:48 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:01:48 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:01:48 user nova-compute[72803]:   </os>
Aug 15 07:01:48 user nova-compute[72803]:   <features>
Aug 15 07:01:48 user nova-compute[72803]:     <acpi/>
Aug 15 07:01:48 user nova-compute[72803]:     <apic/>
Aug 15 07:01:48 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:01:48 user nova-compute[72803]:   </features>
Aug 15 07:01:48 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:01:48 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:01:48 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:01:48 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:01:48 user nova-compute[72803]:   </clock>
Aug 15 07:01:48 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:01:48 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:01:48 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:01:48 user nova-compute[72803]:   </cpu>
Aug 15 07:01:48 user nova-compute[72803]:   <devices>
Aug 15 07:01:48 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:01:48 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:01:48 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk"/>
Aug 15 07:01:48 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:01:48 user nova-compute[72803]:     </disk>
Aug 15 07:01:48 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:01:48 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:01:48 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 07:01:48 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:01:48 user nova-compute[72803]:       <serial>2a7c447c-91dc-45d2-b672-c916022fedd2</serial>
Aug 15 07:01:48 user nova-compute[72803]:     </disk>
Aug 15 07:01:48 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:01:48 user nova-compute[72803]:       <mac address="fa:16:3e:96:fd:20"/>
Aug 15 07:01:48 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:01:48 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:01:48 user nova-compute[72803]:       <target dev="tapb3c670dd-02"/>
Aug 15 07:01:48 user nova-compute[72803]:     </interface>
Aug 15 07:01:48 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:01:48 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/console.log" append="off"/>
Aug 15 07:01:48 user nova-compute[72803]:     </serial>
Aug 15 07:01:48 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:01:48 user nova-compute[72803]:     <video>
Aug 15 07:01:48 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:01:48 user nova-compute[72803]:     </video>
Aug 15 07:01:48 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:01:48 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:01:48 user nova-compute[72803]:     </rng>
Aug 15 07:01:48 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:01:48 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:01:48 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:01:48 user nova-compute[72803]:     </memballoon>
Aug 15 07:01:48 user nova-compute[72803]:   </devices>
Aug 15 07:01:48 user nova-compute[72803]: </domain>
Aug 15 07:01:48 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T06:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-434501159',display_name='tempest-ServerActionsTestOtherA-server-221183768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-434501159',id=16,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUZ/EwNsA5ruMIw3IDFFAGkJQBK1O6/57tM7BxohUJ7SYDtPC3cHhbHxvpQ+BwkgtdivuuuprwjP+NluswpG70oDt4GOKuJikiDEf0XWiaJ8X18OMWn/ICQApxHaZ4GAQ==',key_name='tempest-keypair-2020809915',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-9c6fhw9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:01:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=06a22c66-fe35-4c52-aef9-9801f38d2832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG os_vif [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3c670dd-02, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3c670dd-02, col_values=(('external_ids', {'iface-id': 'b3c670dd-02a1-4d2c-867a-450884798f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:fd:20', 'vm-uuid': '06a22c66-fe35-4c52-aef9-9801f38d2832'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:48 user nova-compute[72803]: INFO os_vif [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02')
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:01:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No VIF found with MAC fa:16:3e:96:fd:20, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:01:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:49 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082893.9318366, 06a22c66-fe35-4c52-aef9-9801f38d2832 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:01:49 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] VM Stopped (Lifecycle Event)
Aug 15 07:01:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e59a290d-6ebf-4c73-9a4e-3aa07108cb7e None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-b86252b7-6cd4-4811-a151-c187f8f3a98a req-ce991499-218e-4dba-b0c4-032e2c5ca0db service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b86252b7-6cd4-4811-a151-c187f8f3a98a req-ce991499-218e-4dba-b0c4-032e2c5ca0db service nova] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b86252b7-6cd4-4811-a151-c187f8f3a98a req-ce991499-218e-4dba-b0c4-032e2c5ca0db service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.014s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b86252b7-6cd4-4811-a151-c187f8f3a98a req-ce991499-218e-4dba-b0c4-032e2c5ca0db service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-b86252b7-6cd4-4811-a151-c187f8f3a98a req-ce991499-218e-4dba-b0c4-032e2c5ca0db service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] No waiting events found dispatching network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:50 user nova-compute[72803]: WARNING nova.compute.manager [req-b86252b7-6cd4-4811-a151-c187f8f3a98a req-ce991499-218e-4dba-b0c4-032e2c5ca0db service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received unexpected event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 07:01:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082912.4137256, 06a22c66-fe35-4c52-aef9-9801f38d2832 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:01:52 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] VM Resumed (Lifecycle Event)
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:01:52 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance spawned successfully.
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-970db9e5-f356-4785-8593-a3dab24f8e13 req-0aae6080-1c5e-4a0f-971d-0df5258d4b6c service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-970db9e5-f356-4785-8593-a3dab24f8e13 req-0aae6080-1c5e-4a0f-971d-0df5258d4b6c service nova] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-970db9e5-f356-4785-8593-a3dab24f8e13 req-0aae6080-1c5e-4a0f-971d-0df5258d4b6c service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-970db9e5-f356-4785-8593-a3dab24f8e13 req-0aae6080-1c5e-4a0f-971d-0df5258d4b6c service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-970db9e5-f356-4785-8593-a3dab24f8e13 req-0aae6080-1c5e-4a0f-971d-0df5258d4b6c service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] No waiting events found dispatching network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:01:52 user nova-compute[72803]: WARNING nova.compute.manager [req-970db9e5-f356-4785-8593-a3dab24f8e13 req-0aae6080-1c5e-4a0f-971d-0df5258d4b6c service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received unexpected event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 07:01:52 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082912.4153004, 06a22c66-fe35-4c52-aef9-9801f38d2832 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:01:52 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] VM Started (Lifecycle Event)
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:01:52 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72803) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 07:01:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8bdbf7ed-56d2-43c8-b2d5-0dd013c09d70 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:01:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:01:59 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082904.7447329, 16812ff4-f16a-483b-8614-6d7a3efc4725 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:01:59 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] VM Stopped (Lifecycle Event)
Aug 15 07:01:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b22788db-8d03-436e-804e-ef7212604fe6 None None] [instance: 16812ff4-f16a-483b-8614-6d7a3efc4725] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_power_states {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 0777bcb5-966e-424a-8732-e53c6352183e {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "454ea345-aaa5-423b-add3-20a933978eec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "0777bcb5-966e-424a-8732-e53c6352183e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "5170f08d-a847-4094-82b7-749797acf8b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "5170f08d-a847-4094-82b7-749797acf8b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "454ea345-aaa5-423b-add3-20a933978eec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.158s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "0777bcb5-966e-424a-8732-e53c6352183e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.176s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.198s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:03 user nova-compute[72803]: INFO nova.compute.manager [None req-95c2c98c-20c3-4e4f-ab1d-91671eb6c56a tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Unrescuing
Aug 15 07:02:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-95c2c98c-20c3-4e4f-ab1d-91671eb6c56a tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:02:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-95c2c98c-20c3-4e4f-ab1d-91671eb6c56a tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquired lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:02:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-95c2c98c-20c3-4e4f-ab1d-91671eb6c56a tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:02:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-95c2c98c-20c3-4e4f-ab1d-91671eb6c56a tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updating instance_info_cache with network_info: [{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-95c2c98c-20c3-4e4f-ab1d-91671eb6c56a tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Releasing lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:02:04 user nova-compute[72803]: DEBUG nova.objects.instance [None req-95c2c98c-20c3-4e4f-ab1d-91671eb6c56a tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'flavor' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:04 user nova-compute[72803]: INFO nova.compute.manager [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Terminating instance
Aug 15 07:02:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-98ec1871-1630-4a86-b504-a204e2352a61 req-4e0c05da-9a79-480c-81dc-ceab5324d339 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received event network-vif-unplugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-98ec1871-1630-4a86-b504-a204e2352a61 req-4e0c05da-9a79-480c-81dc-ceab5324d339 service nova] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-98ec1871-1630-4a86-b504-a204e2352a61 req-4e0c05da-9a79-480c-81dc-ceab5324d339 service nova] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-98ec1871-1630-4a86-b504-a204e2352a61 req-4e0c05da-9a79-480c-81dc-ceab5324d339 service nova] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-98ec1871-1630-4a86-b504-a204e2352a61 req-4e0c05da-9a79-480c-81dc-ceab5324d339 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] No waiting events found dispatching network-vif-unplugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-98ec1871-1630-4a86-b504-a204e2352a61 req-4e0c05da-9a79-480c-81dc-ceab5324d339 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received event network-vif-unplugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:02:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Instance destroyed successfully.
Aug 15 07:02:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lazy-loading 'resources' on Instance uuid 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-297169688',display_name='tempest-VolumesAdminNegativeTest-server-297169688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-297169688',id=5,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQzz+C54ASqxtg5jc2/cB8BUpPKfINOhMAnTO0I7Sgd21i3Cc837DTVVROvSdzaZw+YT1HdgF6l2As6cgdflUMPHlQztJ2aq9fPaf5wM2MM7shvt8AYS1xBfFt6XixguQ==',key_name='tempest-keypair-858397056',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1922e1157f794f3e8eee8df93e0a6276',ramdisk_id='',reservation_id='r-731tvcwb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1805149867',owner_user_name='tempest-VolumesAdminNegativeTest-1805149867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e992a5e7525e41249ddd5e6fbf1cd24c',uuid=5c54f0cc-decb-4c4c-a9ef-ab4aecc41060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converting VIF {"id": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "address": "fa:16:3e:b7:af:27", "network": {"id": "b90fe209-6f8d-486f-a631-ef9a893a349b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-419765156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1922e1157f794f3e8eee8df93e0a6276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a98be4-bb", "ovs_interfaceid": "d9a98be4-bb66-4f3f-a354-5a1767c3c891", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:af:27,bridge_name='br-int',has_traffic_filtering=True,id=d9a98be4-bb66-4f3f-a354-5a1767c3c891,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a98be4-bb') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG os_vif [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:af:27,bridge_name='br-int',has_traffic_filtering=True,id=d9a98be4-bb66-4f3f-a354-5a1767c3c891,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a98be4-bb') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9a98be4-bb, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:02:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance destroyed successfully.
Aug 15 07:02:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:06 user nova-compute[72803]: INFO os_vif [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:af:27,bridge_name='br-int',has_traffic_filtering=True,id=d9a98be4-bb66-4f3f-a354-5a1767c3c891,network=Network(b90fe209-6f8d-486f-a631-ef9a893a349b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a98be4-bb')
Aug 15 07:02:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Deleting instance files /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060_del
Aug 15 07:02:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Deletion of /opt/stack/data/nova/instances/5c54f0cc-decb-4c4c-a9ef-ab4aecc41060_del complete
Aug 15 07:02:06 user nova-compute[72803]: INFO nova.compute.manager [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 15 07:02:06 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-8fa32d34-d262-481c-816a-3e6fff822b87 req-3dbff332-d1ec-4ae7-baff-fab586719228 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8fa32d34-d262-481c-816a-3e6fff822b87 req-3dbff332-d1ec-4ae7-baff-fab586719228 service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8fa32d34-d262-481c-816a-3e6fff822b87 req-3dbff332-d1ec-4ae7-baff-fab586719228 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8fa32d34-d262-481c-816a-3e6fff822b87 req-3dbff332-d1ec-4ae7-baff-fab586719228 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-8fa32d34-d262-481c-816a-3e6fff822b87 req-3dbff332-d1ec-4ae7-baff-fab586719228 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:06 user nova-compute[72803]: WARNING nova.compute.manager [req-8fa32d34-d262-481c-816a-3e6fff822b87 req-3dbff332-d1ec-4ae7-baff-fab586719228 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:02:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-5b21f814-b9c0-4837-9b5a-57dd057884b3 req-db09bbd0-c2cd-49ab-9a8b-b82a6b63df60 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received event network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5b21f814-b9c0-4837-9b5a-57dd057884b3 req-db09bbd0-c2cd-49ab-9a8b-b82a6b63df60 service nova] Acquiring lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5b21f814-b9c0-4837-9b5a-57dd057884b3 req-db09bbd0-c2cd-49ab-9a8b-b82a6b63df60 service nova] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5b21f814-b9c0-4837-9b5a-57dd057884b3 req-db09bbd0-c2cd-49ab-9a8b-b82a6b63df60 service nova] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-5b21f814-b9c0-4837-9b5a-57dd057884b3 req-db09bbd0-c2cd-49ab-9a8b-b82a6b63df60 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] No waiting events found dispatching network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:07 user nova-compute[72803]: WARNING nova.compute.manager [req-5b21f814-b9c0-4837-9b5a-57dd057884b3 req-db09bbd0-c2cd-49ab-9a8b-b82a6b63df60 service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received unexpected event network-vif-plugged-d9a98be4-bb66-4f3f-a354-5a1767c3c891 for instance with vm_state active and task_state deleting.
Aug 15 07:02:07 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:07 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Took 1.60 seconds to deallocate network for instance.
Aug 15 07:02:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:08 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Deleted allocations for instance 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060
Aug 15 07:02:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-730ebc4d-0bd4-4a47-8b6a-1c2ba566923f tempest-VolumesAdminNegativeTest-1805149867 tempest-VolumesAdminNegativeTest-1805149867-project-member] Lock "5c54f0cc-decb-4c4c-a9ef-ab4aecc41060" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.820s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-92dca0ad-2f1f-4839-ab5b-0722d93e0267 req-2a45de4f-f01a-4d41-9b68-f65fa3d5e445 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-92dca0ad-2f1f-4839-ab5b-0722d93e0267 req-2a45de4f-f01a-4d41-9b68-f65fa3d5e445 service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-92dca0ad-2f1f-4839-ab5b-0722d93e0267 req-2a45de4f-f01a-4d41-9b68-f65fa3d5e445 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-92dca0ad-2f1f-4839-ab5b-0722d93e0267 req-2a45de4f-f01a-4d41-9b68-f65fa3d5e445 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-92dca0ad-2f1f-4839-ab5b-0722d93e0267 req-2a45de4f-f01a-4d41-9b68-f65fa3d5e445 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:08 user nova-compute[72803]: WARNING nova.compute.manager [req-92dca0ad-2f1f-4839-ab5b-0722d93e0267 req-2a45de4f-f01a-4d41-9b68-f65fa3d5e445 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:02:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:09 user nova-compute[72803]: INFO nova.compute.manager [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Terminating instance
Aug 15 07:02:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-05abc9a4-a59c-4a23-b3c6-dbe5c0e4e093 req-87148305-2c82-4a02-af8e-c3baec4670ab service nova] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Received event network-vif-deleted-d9a98be4-bb66-4f3f-a354-5a1767c3c891 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Instance destroyed successfully.
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'resources' on Instance uuid 454ea345-aaa5-423b-add3-20a933978eec {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T06:55:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1152789104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1152789104',id=2,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyuK0T+jZdeRbyAIRejk7h3Ml+YmKlkGNdFeM7qM3Ug6lUIK5jXhgYrxd4X/ihahxzn/CahnDI1epyjgQifpsf5mhRksc8sd/Cf/kMl3QRRbB6UOkZUEN18an3vjOJoQw==',key_name='tempest-keypair-577174082',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-11vl8r1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:59:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=454ea345-aaa5-423b-add3-20a933978eec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "address": "fa:16:3e:47:dd:5e", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01af57c9-c0", "ovs_interfaceid": "01af57c9-c09e-45b8-8ba5-c90a6c729ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG os_vif [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01af57c9-c0, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:02:10 user nova-compute[72803]: INFO os_vif [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:dd:5e,bridge_name='br-int',has_traffic_filtering=True,id=01af57c9-c09e-45b8-8ba5-c90a6c729ec9,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01af57c9-c0')
Aug 15 07:02:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Deleting instance files /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec_del
Aug 15 07:02:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Deletion of /opt/stack/data/nova/instances/454ea345-aaa5-423b-add3-20a933978eec_del complete
Aug 15 07:02:10 user nova-compute[72803]: INFO nova.compute.manager [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 07:02:10 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for a4a01678-2255-4fb5-a497-1ceaab81422a due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082930.5717456, a4a01678-2255-4fb5-a497-1ceaab81422a => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] VM Resumed (Lifecycle Event)
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-95c2c98c-20c3-4e4f-ab1d-91671eb6c56a tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:02:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082930.573526, a4a01678-2255-4fb5-a497-1ceaab81422a => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] VM Started (Lifecycle Event)
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:11 user nova-compute[72803]: WARNING nova.compute.manager [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state active and task_state None.
Aug 15 07:02:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:11 user nova-compute[72803]: WARNING nova.compute.manager [req-5ef5bcb8-6518-4b55-9de2-9ad3b2cc5336 req-9c848dd5-f72a-4e39-8741-459b0a7e649d service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state active and task_state None.
Aug 15 07:02:11 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:11 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Took 1.30 seconds to deallocate network for instance.
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:11 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Deleted allocations for instance 454ea345-aaa5-423b-add3-20a933978eec
Aug 15 07:02:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-da09d758-eb77-4510-b170-f6055fc4dd0f req-87ac63c2-779b-4abf-8f49-8a5032233519 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-deleted-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c70e1148-0c5e-486c-8692-871e1f65b25c tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "454ea345-aaa5-423b-add3-20a933978eec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.754s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-unplugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] No waiting events found dispatching network-vif-unplugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:13 user nova-compute[72803]: WARNING nova.compute.manager [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received unexpected event network-vif-unplugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 for instance with vm_state deleted and task_state None.
Aug 15 07:02:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] Acquiring lock "454ea345-aaa5-423b-add3-20a933978eec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] Lock "454ea345-aaa5-423b-add3-20a933978eec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] No waiting events found dispatching network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:13 user nova-compute[72803]: WARNING nova.compute.manager [req-99a3f9c4-9ad0-4a73-9284-7365da6fcf42 req-0c2b23fd-17f4-40f6-9684-267cd13680d5 service nova] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Received unexpected event network-vif-plugged-01af57c9-c09e-45b8-8ba5-c90a6c729ec9 for instance with vm_state deleted and task_state None.
Aug 15 07:02:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-541b57e7-19b4-4f35-8206-f15495c1336d req-6d7f81bc-c9bf-467c-934a-c67e06902299 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-changed-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-541b57e7-19b4-4f35-8206-f15495c1336d req-6d7f81bc-c9bf-467c-934a-c67e06902299 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Refreshing instance network info cache due to event network-changed-7026c22f-40fe-4665-9fb8-5d116dfe7513. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-541b57e7-19b4-4f35-8206-f15495c1336d req-6d7f81bc-c9bf-467c-934a-c67e06902299 service nova] Acquiring lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-541b57e7-19b4-4f35-8206-f15495c1336d req-6d7f81bc-c9bf-467c-934a-c67e06902299 service nova] Acquired lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-541b57e7-19b4-4f35-8206-f15495c1336d req-6d7f81bc-c9bf-467c-934a-c67e06902299 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Refreshing network info cache for port 7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-541b57e7-19b4-4f35-8206-f15495c1336d req-6d7f81bc-c9bf-467c-934a-c67e06902299 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updated VIF entry in instance network info cache for port 7026c22f-40fe-4665-9fb8-5d116dfe7513. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-541b57e7-19b4-4f35-8206-f15495c1336d req-6d7f81bc-c9bf-467c-934a-c67e06902299 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-541b57e7-19b4-4f35-8206-f15495c1336d req-6d7f81bc-c9bf-467c-934a-c67e06902299 service nova] Releasing lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:02:21 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082926.1000013, 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:21 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] VM Stopped (Lifecycle Event)
Aug 15 07:02:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-539e1ef1-e264-41b4-9509-ea537073b523 None None] [instance: 5c54f0cc-decb-4c4c-a9ef-ab4aecc41060] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG nova.objects.instance [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:02:24 user nova-compute[72803]: INFO nova.compute.claims [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Claim successful on node user
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:24 user nova-compute[72803]: INFO nova.compute.manager [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Attaching volume 909730d3-22b7-4511-8621-39bafd2e5359 to /dev/vdb
Aug 15 07:02:24 user nova-compute[72803]: DEBUG os_brick.utils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[88edf9a8-b8cd-440d-9c94-6ce65246f8da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd80808-e1b7-4b9d-bebe-d7bd23740f27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[18959225-b924-47e8-a7bd-66fd92095b95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c2285f-1380-41fc-8f8a-ae86a3aa950a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:02:25 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b78ad6-450b-4479-ae3c-2ecbb235007d]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.utils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating existing volume attachment record: 264dc839-50e4-4ebb-ac80-feef330fd9fa {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082930.0476792, 454ea345-aaa5-423b-add3-20a933978eec => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:25 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 454ea345-aaa5-423b-add3-20a933978eec] VM Stopped (Lifecycle Event)
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8430100e-c2e3-4913-8c17-79195de738f3 None None] [instance: 454ea345-aaa5-423b-add3-20a933978eec] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.network.neutron [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:02:25 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:02:25 user nova-compute[72803]: INFO nova.virt.block_device [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Booting with volume 12fd62d1-26cb-42f9-a2c5-9b601d7fac9a at /dev/vda
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.policy [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10b9814cfdf2413c9d0ed361ed3aa46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ba51fa2449daae318ca760c32784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.utils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d238786-9810-45c9-a26a-d540d0e0c349]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1728a29b-e56e-4f3b-be88-f466077efd6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da5298a-a52d-465f-bf48-a7b44219868f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d93249-38b9-45f1-9da5-dfac57d82aac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:02:25 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:02:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8025f3ce-8271-484c-9997-c67a11817f8b]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG os_brick.utils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:02:25 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating existing volume attachment record: 6e3835d5-1c4b-4d05-a7a5-e84b721de5f5 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Successfully created port: 2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:02:26 user nova-compute[72803]: INFO nova.compute.claims [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Claim successful on node user
Aug 15 07:02:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Successfully updated port: 2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquired lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:02:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-1b914e5b-3a33-431d-a592-bc33af9215ee req-8d70074b-ae56-4225-88e4-010f776a935d service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-1b914e5b-3a33-431d-a592-bc33af9215ee req-8d70074b-ae56-4225-88e4-010f776a935d service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing instance network info cache due to event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1b914e5b-3a33-431d-a592-bc33af9215ee req-8d70074b-ae56-4225-88e4-010f776a935d service nova] Acquiring lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.network.neutron [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.network.neutron [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:02:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.policy [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50b2d95238654df88548e1549fa73210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3743fde3d93f4fed84b52926dadc07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:02:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Creating image(s)
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "/opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "/opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.network.neutron [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Releasing lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance network_info: |[{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1b914e5b-3a33-431d-a592-bc33af9215ee req-8d70074b-ae56-4225-88e4-010f776a935d service nova] Acquired lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.network.neutron [req-1b914e5b-3a33-431d-a592-bc33af9215ee req-8d70074b-ae56-4225-88e4-010f776a935d service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.218s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk 1073741824" returned: 0 in 0.050s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.network.neutron [req-1b914e5b-3a33-431d-a592-bc33af9215ee req-8d70074b-ae56-4225-88e4-010f776a935d service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updated VIF entry in instance network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.network.neutron [req-1b914e5b-3a33-431d-a592-bc33af9215ee req-8d70074b-ae56-4225-88e4-010f776a935d service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1b914e5b-3a33-431d-a592-bc33af9215ee req-8d70074b-ae56-4225-88e4-010f776a935d service nova] Releasing lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.204s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:02:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Successfully created port: 7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Cannot resize image /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'migration_context' on Instance uuid f5cf8ddf-e3c0-403e-91ff-ca1233b33576 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Ensure instance console log exists: /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Successfully updated port: 7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquired lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:02:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-ac5e246c-e24b-48c8-ad6d-a71d716076b9 req-b08533a7-521b-4184-93fc-6d8d464d88d3 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received event network-changed-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-ac5e246c-e24b-48c8-ad6d-a71d716076b9 req-b08533a7-521b-4184-93fc-6d8d464d88d3 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Refreshing instance network info cache due to event network-changed-7aa521d7-60f7-4b67-836d-1c4e6bd8c131. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac5e246c-e24b-48c8-ad6d-a71d716076b9 req-b08533a7-521b-4184-93fc-6d8d464d88d3 service nova] Acquiring lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.neutron [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Updating instance_info_cache with network_info: [{"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Releasing lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Instance network_info: |[{"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac5e246c-e24b-48c8-ad6d-a71d716076b9 req-b08533a7-521b-4184-93fc-6d8d464d88d3 service nova] Acquired lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.neutron [req-ac5e246c-e24b-48c8-ad6d-a71d716076b9 req-b08533a7-521b-4184-93fc-6d8d464d88d3 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Refreshing network info cache for port 7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Start _get_guest_xml network_info=[{"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:02:29 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:02:29 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323940789',display_name='tempest-AttachVolumeNegativeTest-server-1323940789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323940789',id=20,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIodbd/VmZQ62+n4oaG12QN2fp86CGbygXI7eJaL+QVPx9ysUWQ3zPv5zkbGh+1HuCj0IX2UAFXV3yZK7YESlKcpRYi2Q1krhDVPZCdl7gnUeFOLGWPK2AuKmVTWHfz/UQ==',key_name='tempest-keypair-775690106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-4tr4egmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=f5cf8ddf-e3c0-403e-91ff-ca1233b33576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=7aa521d7-60f7-4b67-836d-1c4e6bd8c131,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa521d7-60') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'pci_devices' on Instance uuid f5cf8ddf-e3c0-403e-91ff-ca1233b33576 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:02:29 user nova-compute[72803]:   <uuid>f5cf8ddf-e3c0-403e-91ff-ca1233b33576</uuid>
Aug 15 07:02:29 user nova-compute[72803]:   <name>instance-00000014</name>
Aug 15 07:02:29 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:02:29 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:02:29 user nova-compute[72803]:   <metadata>
Aug 15 07:02:29 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:02:29 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:02:29 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1323940789</nova:name>
Aug 15 07:02:29 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:02:29</nova:creationTime>
Aug 15 07:02:29 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:02:29 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:02:29 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:02:29 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:02:29 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:02:29 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:02:29 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:02:29 user nova-compute[72803]:       <nova:owner>
Aug 15 07:02:29 user nova-compute[72803]:         <nova:user uuid="50b2d95238654df88548e1549fa73210">tempest-AttachVolumeNegativeTest-37766204-project-member</nova:user>
Aug 15 07:02:29 user nova-compute[72803]:         <nova:project uuid="3743fde3d93f4fed84b52926dadc07f7">tempest-AttachVolumeNegativeTest-37766204</nova:project>
Aug 15 07:02:29 user nova-compute[72803]:       </nova:owner>
Aug 15 07:02:29 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:02:29 user nova-compute[72803]:       <nova:ports>
Aug 15 07:02:29 user nova-compute[72803]:         <nova:port uuid="7aa521d7-60f7-4b67-836d-1c4e6bd8c131">
Aug 15 07:02:29 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 07:02:29 user nova-compute[72803]:         </nova:port>
Aug 15 07:02:29 user nova-compute[72803]:       </nova:ports>
Aug 15 07:02:29 user nova-compute[72803]:     </nova:instance>
Aug 15 07:02:29 user nova-compute[72803]:   </metadata>
Aug 15 07:02:29 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:02:29 user nova-compute[72803]:     <system>
Aug 15 07:02:29 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:02:29 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:02:29 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:02:29 user nova-compute[72803]:       <entry name="serial">f5cf8ddf-e3c0-403e-91ff-ca1233b33576</entry>
Aug 15 07:02:29 user nova-compute[72803]:       <entry name="uuid">f5cf8ddf-e3c0-403e-91ff-ca1233b33576</entry>
Aug 15 07:02:29 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:02:29 user nova-compute[72803]:     </system>
Aug 15 07:02:29 user nova-compute[72803]:   </sysinfo>
Aug 15 07:02:29 user nova-compute[72803]:   <os>
Aug 15 07:02:29 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:02:29 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:02:29 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:02:29 user nova-compute[72803]:   </os>
Aug 15 07:02:29 user nova-compute[72803]:   <features>
Aug 15 07:02:29 user nova-compute[72803]:     <acpi/>
Aug 15 07:02:29 user nova-compute[72803]:     <apic/>
Aug 15 07:02:29 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:02:29 user nova-compute[72803]:   </features>
Aug 15 07:02:29 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:02:29 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:02:29 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:02:29 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:02:29 user nova-compute[72803]:   </clock>
Aug 15 07:02:29 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:02:29 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:02:29 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:02:29 user nova-compute[72803]:   </cpu>
Aug 15 07:02:29 user nova-compute[72803]:   <devices>
Aug 15 07:02:29 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:02:29 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:02:29 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk"/>
Aug 15 07:02:29 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:02:29 user nova-compute[72803]:     </disk>
Aug 15 07:02:29 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:02:29 user nova-compute[72803]:       <mac address="fa:16:3e:f1:f6:51"/>
Aug 15 07:02:29 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:02:29 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:02:29 user nova-compute[72803]:       <target dev="tap7aa521d7-60"/>
Aug 15 07:02:29 user nova-compute[72803]:     </interface>
Aug 15 07:02:29 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:02:29 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/console.log" append="off"/>
Aug 15 07:02:29 user nova-compute[72803]:     </serial>
Aug 15 07:02:29 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:02:29 user nova-compute[72803]:     <video>
Aug 15 07:02:29 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:02:29 user nova-compute[72803]:     </video>
Aug 15 07:02:29 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:02:29 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:02:29 user nova-compute[72803]:     </rng>
Aug 15 07:02:29 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:02:29 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:02:29 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:02:29 user nova-compute[72803]:     </memballoon>
Aug 15 07:02:29 user nova-compute[72803]:   </devices>
Aug 15 07:02:29 user nova-compute[72803]: </domain>
Aug 15 07:02:29 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323940789',display_name='tempest-AttachVolumeNegativeTest-server-1323940789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323940789',id=20,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIodbd/VmZQ62+n4oaG12QN2fp86CGbygXI7eJaL+QVPx9ysUWQ3zPv5zkbGh+1HuCj0IX2UAFXV3yZK7YESlKcpRYi2Q1krhDVPZCdl7gnUeFOLGWPK2AuKmVTWHfz/UQ==',key_name='tempest-keypair-775690106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-4tr4egmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=f5cf8ddf-e3c0-403e-91ff-ca1233b33576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=7aa521d7-60f7-4b67-836d-1c4e6bd8c131,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa521d7-60') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG os_vif [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=7aa521d7-60f7-4b67-836d-1c4e6bd8c131,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa521d7-60') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7aa521d7-60, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7aa521d7-60, col_values=(('external_ids', {'iface-id': '7aa521d7-60f7-4b67-836d-1c4e6bd8c131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:f6:51', 'vm-uuid': 'f5cf8ddf-e3c0-403e-91ff-ca1233b33576'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:29 user nova-compute[72803]: INFO os_vif [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=7aa521d7-60f7-4b67-836d-1c4e6bd8c131,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa521d7-60')
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No VIF found with MAC fa:16:3e:f1:f6:51, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.neutron [req-ac5e246c-e24b-48c8-ad6d-a71d716076b9 req-b08533a7-521b-4184-93fc-6d8d464d88d3 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Updated VIF entry in instance network info cache for port 7aa521d7-60f7-4b67-836d-1c4e6bd8c131. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG nova.network.neutron [req-ac5e246c-e24b-48c8-ad6d-a71d716076b9 req-b08533a7-521b-4184-93fc-6d8d464d88d3 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Updating instance_info_cache with network_info: [{"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac5e246c-e24b-48c8-ad6d-a71d716076b9 req-b08533a7-521b-4184-93fc-6d8d464d88d3 service nova] Releasing lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:02:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:30 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-5652f198-0609-46f0-a218-dc522cb693eb req-2c59d42b-e392-4902-b723-79591e4baa28 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received event network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5652f198-0609-46f0-a218-dc522cb693eb req-2c59d42b-e392-4902-b723-79591e4baa28 service nova] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5652f198-0609-46f0-a218-dc522cb693eb req-2c59d42b-e392-4902-b723-79591e4baa28 service nova] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5652f198-0609-46f0-a218-dc522cb693eb req-2c59d42b-e392-4902-b723-79591e4baa28 service nova] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-5652f198-0609-46f0-a218-dc522cb693eb req-2c59d42b-e392-4902-b723-79591e4baa28 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] No waiting events found dispatching network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:31 user nova-compute[72803]: WARNING nova.compute.manager [req-5652f198-0609-46f0-a218-dc522cb693eb req-2c59d42b-e392-4902-b723-79591e4baa28 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received unexpected event network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 for instance with vm_state building and task_state spawning.
Aug 15 07:02:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Skipping network cache update for instance because it is Building. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Skipping network cache update for instance because it is Building. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:02:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082953.2529447, f5cf8ddf-e3c0-403e-91ff-ca1233b33576 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] VM Resumed (Lifecycle Event)
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:02:33 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Instance spawned successfully.
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082953.2545054, f5cf8ddf-e3c0-403e-91ff-ca1233b33576 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] VM Started (Lifecycle Event)
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:02:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-e309ab87-0bca-4bb3-89bd-4c29915a31d7 req-a2c67ec0-5ea5-452e-9960-f78513b18a0f service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received event network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e309ab87-0bca-4bb3-89bd-4c29915a31d7 req-a2c67ec0-5ea5-452e-9960-f78513b18a0f service nova] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e309ab87-0bca-4bb3-89bd-4c29915a31d7 req-a2c67ec0-5ea5-452e-9960-f78513b18a0f service nova] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e309ab87-0bca-4bb3-89bd-4c29915a31d7 req-a2c67ec0-5ea5-452e-9960-f78513b18a0f service nova] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-e309ab87-0bca-4bb3-89bd-4c29915a31d7 req-a2c67ec0-5ea5-452e-9960-f78513b18a0f service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] No waiting events found dispatching network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:33 user nova-compute[72803]: WARNING nova.compute.manager [req-e309ab87-0bca-4bb3-89bd-4c29915a31d7 req-a2c67ec0-5ea5-452e-9960-f78513b18a0f service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received unexpected event network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 for instance with vm_state building and task_state spawning.
Aug 15 07:02:33 user nova-compute[72803]: INFO nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:33 user nova-compute[72803]: INFO nova.compute.manager [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Took 6.88 seconds to build instance.
Aug 15 07:02:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a9fdcc78-73d9-4517-9eda-c8784535c061 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.996s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updating instance_info_cache with network_info: [{"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJTviluY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:02:38 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:02:38 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:02:38 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:02:38 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8033MB free_disk=25.610416412353516GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b3674-a9b6-44de-ab09-03a07e80732f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:02:38 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238e328-abca-4348-bbbd-b5cbdbd7ea21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359] added
Aug 15 07:02:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff8906-dcca-423c-95b9-0ae90776e73e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4909e483-1587-403e-a70d-cfe133dc2796]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJTviluY {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJTviluY" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aaa447-1428-4b57-a136-47b8b3cc3916]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJTviluY'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 06a22c66-fe35-4c52-aef9-9801f38d2832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 506ed7b9-6081-418b-86a8-278db430893e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1287bfb7-e758-45b7-ae63-fdf9d1f2f68b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e77203-49e6-449b-b5d0-898e88333ba2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[263e4f50-61f5-4d48-ab64-3b430a2191dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260]
Aug 15 07:02:38 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260] successful.
Aug 15 07:02:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08d69ec-67de-44ed-8124-6a3b9fa6ba76]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f471f200-3162-452a-868c-01ea3bd2f1d4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:02:38 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fde8fe-3dc6-4943-b2aa-0187fef15589]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:02:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJTviluY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '26230343363363234', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230343363363234', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:02:39 user nova-compute[72803]: DEBUG nova.objects.instance [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:02:40 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:02:40 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:02:40 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:02:40 user nova-compute[72803]:   <serial>909730d3-22b7-4511-8621-39bafd2e5359</serial>
Aug 15 07:02:40 user nova-compute[72803]: </disk>
Aug 15 07:02:40 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:02:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:02:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:02:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No VIF found with MAC fa:16:3e:b8:f9:8b, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:02:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-98530504-eb66-42d1-bfc7-4a245939b4ca tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.876s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f48c6b7b-afad-46d0-b42e-7494c88b2ca1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f48c6b7b-afad-46d0-b42e-7494c88b2ca1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f48c6b7b-afad-46d0-b42e-7494c88b2ca1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f48c6b7b-afad-46d0-b42e-7494c88b2ca1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72803) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f48c6b7b-afad-46d0-b42e-7494c88b2ca1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-53d1b139-8083-48b3-860d-529264587b03 req-0b95b763-4e00-4e20-8e61-fe3a88e7345c service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-53d1b139-8083-48b3-860d-529264587b03 req-0b95b763-4e00-4e20-8e61-fe3a88e7345c service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-53d1b139-8083-48b3-860d-529264587b03 req-0b95b763-4e00-4e20-8e61-fe3a88e7345c service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-53d1b139-8083-48b3-860d-529264587b03 req-0b95b763-4e00-4e20-8e61-fe3a88e7345c service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-53d1b139-8083-48b3-860d-529264587b03 req-0b95b763-4e00-4e20-8e61-fe3a88e7345c service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:42 user nova-compute[72803]: WARNING nova.compute.manager [req-53d1b139-8083-48b3-860d-529264587b03 req-0b95b763-4e00-4e20-8e61-fe3a88e7345c service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state active and task_state powering-off.
Aug 15 07:02:42 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance destroyed successfully.
Aug 15 07:02:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f48c6b7b-afad-46d0-b42e-7494c88b2ca1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f48c6b7b-afad-46d0-b42e-7494c88b2ca1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.957s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-3874b016-260b-4abf-a9b4-31026204db46 req-35e26778-94ff-419b-9a12-5dd97be14f3b service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3874b016-260b-4abf-a9b4-31026204db46 req-35e26778-94ff-419b-9a12-5dd97be14f3b service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3874b016-260b-4abf-a9b4-31026204db46 req-35e26778-94ff-419b-9a12-5dd97be14f3b service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3874b016-260b-4abf-a9b4-31026204db46 req-35e26778-94ff-419b-9a12-5dd97be14f3b service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-3874b016-260b-4abf-a9b4-31026204db46 req-35e26778-94ff-419b-9a12-5dd97be14f3b service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:44 user nova-compute[72803]: WARNING nova.compute.manager [req-3874b016-260b-4abf-a9b4-31026204db46 req-35e26778-94ff-419b-9a12-5dd97be14f3b service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state stopped and task_state None.
Aug 15 07:02:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:02:46 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Creating image(s)
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Ensure instance console log exists: /opt/stack/data/nova/instances/506ed7b9-6081-418b-86a8-278db430893e/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Start _get_guest_xml network_info=[{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '6e3835d5-1c4b-4d05-a7a5-e84b721de5f5', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxVByZMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '506ed7b9-6081-418b-86a8-278db430893e', 'attached_at': '', 'detached_at': '', 'volume_id': '12fd62d1-26cb-42f9-a2c5-9b601d7fac9a', 'serial': '12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:02:46 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:02:46 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxVByZMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:02:46 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:02:46 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:02:46 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e437c5e4-1c9d-4df9-aef7-a31f6dcdd4d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:02:46 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4b981-7792-4b33-82f5-6cb01cb4275f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a] added
Aug 15 07:02:46 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfd646d-9bca-49d9-9abf-e4ce07e4d5e2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6807661a-e4b0-462b-8c8c-5d6732b22db9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxVByZMq {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxVByZMq" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[060ddffd-c8d5-41e2-b846-10c4e8b76eb3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DxVByZMq'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8120d2-4f35-4716-9567-91c6c74fdd50]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c657b69f-619a-43ec-b8de-248f58620049]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d24836f-0301-445e-9b5c-2f4f128b33ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260]
Aug 15 07:02:46 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260] successful.
Aug 15 07:02:46 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee048536-6ba2-4fc0-a92a-7ae9dcd3f5a2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a936de-16da-42ff-b98e-77f7a47c7487]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:02:46 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:02:46 user nova-compute[72803]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:02:46 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4630bae5-a229-44e9-995a-40e1da692c90]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:02:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxVByZMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26461643736376433', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461643736376433', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1082719568',display_name='tempest-TestShelveInstance-server-1082719568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1082719568',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbYx1mHtDaQkRYxVSgFx3/zYCh0BDptX/w5QUs6vm39XSEWJ8BZXfgKtz7t3wTUrOUYvJerQtU9Q87bW4thFUZhERMvyG/uzW6UFIBtCRlr89WUEXAWXxHYx2ImaDYi8g==',key_name='tempest-TestShelveInstance-2020944849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba0ba51fa2449daae318ca760c32784',ramdisk_id='',reservation_id='r-pyv4bacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1431210887',owner_user_name='tempest-TestShelveInstance-1431210887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:02:25Z,user_data=None,user_id='10b9814cfdf2413c9d0ed361ed3aa46d',uuid=506ed7b9-6081-418b-86a8-278db430893e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converting VIF {"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.objects.instance [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lazy-loading 'pci_devices' on Instance uuid 506ed7b9-6081-418b-86a8-278db430893e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:02:47 user nova-compute[72803]:   <uuid>506ed7b9-6081-418b-86a8-278db430893e</uuid>
Aug 15 07:02:47 user nova-compute[72803]:   <name>instance-00000013</name>
Aug 15 07:02:47 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:02:47 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:02:47 user nova-compute[72803]:   <metadata>
Aug 15 07:02:47 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:02:47 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:02:47 user nova-compute[72803]:       <nova:name>tempest-TestShelveInstance-server-1082719568</nova:name>
Aug 15 07:02:47 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:02:46</nova:creationTime>
Aug 15 07:02:47 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:02:47 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:02:47 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:02:47 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:02:47 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:02:47 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:02:47 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:02:47 user nova-compute[72803]:       <nova:owner>
Aug 15 07:02:47 user nova-compute[72803]:         <nova:user uuid="10b9814cfdf2413c9d0ed361ed3aa46d">tempest-TestShelveInstance-1431210887-project-member</nova:user>
Aug 15 07:02:47 user nova-compute[72803]:         <nova:project uuid="0ba0ba51fa2449daae318ca760c32784">tempest-TestShelveInstance-1431210887</nova:project>
Aug 15 07:02:47 user nova-compute[72803]:       </nova:owner>
Aug 15 07:02:47 user nova-compute[72803]:       <nova:ports>
Aug 15 07:02:47 user nova-compute[72803]:         <nova:port uuid="2e2cc686-e80f-439a-87d6-36f6b8dba07d">
Aug 15 07:02:47 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 07:02:47 user nova-compute[72803]:         </nova:port>
Aug 15 07:02:47 user nova-compute[72803]:       </nova:ports>
Aug 15 07:02:47 user nova-compute[72803]:     </nova:instance>
Aug 15 07:02:47 user nova-compute[72803]:   </metadata>
Aug 15 07:02:47 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:02:47 user nova-compute[72803]:     <system>
Aug 15 07:02:47 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:02:47 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:02:47 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:02:47 user nova-compute[72803]:       <entry name="serial">506ed7b9-6081-418b-86a8-278db430893e</entry>
Aug 15 07:02:47 user nova-compute[72803]:       <entry name="uuid">506ed7b9-6081-418b-86a8-278db430893e</entry>
Aug 15 07:02:47 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:02:47 user nova-compute[72803]:     </system>
Aug 15 07:02:47 user nova-compute[72803]:   </sysinfo>
Aug 15 07:02:47 user nova-compute[72803]:   <os>
Aug 15 07:02:47 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:02:47 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:02:47 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:02:47 user nova-compute[72803]:   </os>
Aug 15 07:02:47 user nova-compute[72803]:   <features>
Aug 15 07:02:47 user nova-compute[72803]:     <acpi/>
Aug 15 07:02:47 user nova-compute[72803]:     <apic/>
Aug 15 07:02:47 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:02:47 user nova-compute[72803]:   </features>
Aug 15 07:02:47 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:02:47 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:02:47 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:02:47 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:02:47 user nova-compute[72803]:   </clock>
Aug 15 07:02:47 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:02:47 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:02:47 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:02:47 user nova-compute[72803]:   </cpu>
Aug 15 07:02:47 user nova-compute[72803]:   <devices>
Aug 15 07:02:47 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:02:47 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:02:47 user nova-compute[72803]:       <source dev="/dev/sdd"/>
Aug 15 07:02:47 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:02:47 user nova-compute[72803]:       <serial>12fd62d1-26cb-42f9-a2c5-9b601d7fac9a</serial>
Aug 15 07:02:47 user nova-compute[72803]:     </disk>
Aug 15 07:02:47 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:02:47 user nova-compute[72803]:       <mac address="fa:16:3e:75:c6:b7"/>
Aug 15 07:02:47 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:02:47 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:02:47 user nova-compute[72803]:       <target dev="tap2e2cc686-e8"/>
Aug 15 07:02:47 user nova-compute[72803]:     </interface>
Aug 15 07:02:47 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:02:47 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/506ed7b9-6081-418b-86a8-278db430893e/console.log" append="off"/>
Aug 15 07:02:47 user nova-compute[72803]:     </serial>
Aug 15 07:02:47 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:02:47 user nova-compute[72803]:     <video>
Aug 15 07:02:47 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:02:47 user nova-compute[72803]:     </video>
Aug 15 07:02:47 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:02:47 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:02:47 user nova-compute[72803]:     </rng>
Aug 15 07:02:47 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:02:47 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:02:47 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:02:47 user nova-compute[72803]:     </memballoon>
Aug 15 07:02:47 user nova-compute[72803]:   </devices>
Aug 15 07:02:47 user nova-compute[72803]: </domain>
Aug 15 07:02:47 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1082719568',display_name='tempest-TestShelveInstance-server-1082719568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1082719568',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbYx1mHtDaQkRYxVSgFx3/zYCh0BDptX/w5QUs6vm39XSEWJ8BZXfgKtz7t3wTUrOUYvJerQtU9Q87bW4thFUZhERMvyG/uzW6UFIBtCRlr89WUEXAWXxHYx2ImaDYi8g==',key_name='tempest-TestShelveInstance-2020944849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba0ba51fa2449daae318ca760c32784',ramdisk_id='',reservation_id='r-pyv4bacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1431210887',owner_user_name='tempest-TestShelveInstance-1431210887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:02:25Z,user_data=None,user_id='10b9814cfdf2413c9d0ed361ed3aa46d',uuid=506ed7b9-6081-418b-86a8-278db430893e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converting VIF {"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG os_vif [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e2cc686-e8, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e2cc686-e8, col_values=(('external_ids', {'iface-id': '2e2cc686-e80f-439a-87d6-36f6b8dba07d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:c6:b7', 'vm-uuid': '506ed7b9-6081-418b-86a8-278db430893e'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:47 user nova-compute[72803]: INFO os_vif [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8')
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:02:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] No VIF found with MAC fa:16:3e:75:c6:b7, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:02:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-c85a7136-d2bc-4103-bee1-2192d14ba373 req-8a4ba67e-9b62-45e8-8dff-4c79880ff3c1 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c85a7136-d2bc-4103-bee1-2192d14ba373 req-8a4ba67e-9b62-45e8-8dff-4c79880ff3c1 service nova] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c85a7136-d2bc-4103-bee1-2192d14ba373 req-8a4ba67e-9b62-45e8-8dff-4c79880ff3c1 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c85a7136-d2bc-4103-bee1-2192d14ba373 req-8a4ba67e-9b62-45e8-8dff-4c79880ff3c1 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-c85a7136-d2bc-4103-bee1-2192d14ba373 req-8a4ba67e-9b62-45e8-8dff-4c79880ff3c1 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] No waiting events found dispatching network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:49 user nova-compute[72803]: WARNING nova.compute.manager [req-c85a7136-d2bc-4103-bee1-2192d14ba373 req-8a4ba67e-9b62-45e8-8dff-4c79880ff3c1 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received unexpected event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d for instance with vm_state building and task_state spawning.
Aug 15 07:02:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082971.264641, 506ed7b9-6081-418b-86a8-278db430893e => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:51 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] VM Resumed (Lifecycle Event)
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:02:51 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance spawned successfully.
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:02:51 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082971.2654505, 506ed7b9-6081-418b-86a8-278db430893e => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:51 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] VM Started (Lifecycle Event)
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:02:51 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:02:51 user nova-compute[72803]: INFO nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-e77e9a20-3e2b-4d2c-b60c-c7a17ebc048e req-8759e553-9256-4d99-ab63-e953e4b303d0 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e77e9a20-3e2b-4d2c-b60c-c7a17ebc048e req-8759e553-9256-4d99-ab63-e953e4b303d0 service nova] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e77e9a20-3e2b-4d2c-b60c-c7a17ebc048e req-8759e553-9256-4d99-ab63-e953e4b303d0 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e77e9a20-3e2b-4d2c-b60c-c7a17ebc048e req-8759e553-9256-4d99-ab63-e953e4b303d0 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-e77e9a20-3e2b-4d2c-b60c-c7a17ebc048e req-8759e553-9256-4d99-ab63-e953e4b303d0 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] No waiting events found dispatching network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:02:51 user nova-compute[72803]: WARNING nova.compute.manager [req-e77e9a20-3e2b-4d2c-b60c-c7a17ebc048e req-8759e553-9256-4d99-ab63-e953e4b303d0 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received unexpected event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d for instance with vm_state building and task_state spawning.
Aug 15 07:02:51 user nova-compute[72803]: INFO nova.compute.manager [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Took 26.78 seconds to build instance.
Aug 15 07:02:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79efb482-decf-414c-a131-135363b92d6b tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.923s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:57 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692082962.3937476, 5170f08d-a847-4094-82b7-749797acf8b7 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:02:57 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Stopped (Lifecycle Event)
Aug 15 07:02:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-55fded1b-113f-4828-ac14-ce2e76634fcc None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:02:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-55fded1b-113f-4828-ac14-ce2e76634fcc None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:02:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:02:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:02:58 user nova-compute[72803]: INFO nova.compute.claims [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Claim successful on node user
Aug 15 07:02:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:02:59 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.policy [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '701c79552e3044d0babde5510a994efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2e755df9744d59e93c26feeec4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:02:59 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Creating image(s)
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.217s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:02:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.264s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk 1073741824" returned: 0 in 0.070s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.272s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Successfully created port: 89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Cannot resize image /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'migration_context' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Ensure instance console log exists: /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:01 user nova-compute[72803]: DEBUG nova.network.neutron [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Successfully updated port: 89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:03:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquired lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:01 user nova-compute[72803]: DEBUG nova.network.neutron [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:03:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4508802-33d5-4b90-ac03-a7298e735e34 req-39235f87-cec8-452f-ae50-6d622fe435ca service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-changed-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4508802-33d5-4b90-ac03-a7298e735e34 req-39235f87-cec8-452f-ae50-6d622fe435ca service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Refreshing instance network info cache due to event network-changed-89d1c280-dac6-41fa-8fb1-0d1b31c21f10. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:03:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4508802-33d5-4b90-ac03-a7298e735e34 req-39235f87-cec8-452f-ae50-6d622fe435ca service nova] Acquiring lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:01 user nova-compute[72803]: DEBUG nova.network.neutron [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Releasing lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance network_info: |[{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4508802-33d5-4b90-ac03-a7298e735e34 req-39235f87-cec8-452f-ae50-6d622fe435ca service nova] Acquired lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.network.neutron [req-a4508802-33d5-4b90-ac03-a7298e735e34 req-39235f87-cec8-452f-ae50-6d622fe435ca service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Refreshing network info cache for port 89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Start _get_guest_xml network_info=[{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:03:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.objects.instance [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'pci_devices' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:03:02 user nova-compute[72803]:   <uuid>ae246e06-40b2-4c05-a7b7-63f016a8ea03</uuid>
Aug 15 07:03:02 user nova-compute[72803]:   <name>instance-00000015</name>
Aug 15 07:03:02 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:03:02 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:03:02 user nova-compute[72803]:   <metadata>
Aug 15 07:03:02 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:03:02 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:03:02 user nova-compute[72803]:       <nova:name>tempest-ServerActionsTestOtherB-server-1170662677</nova:name>
Aug 15 07:03:02 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:03:02</nova:creationTime>
Aug 15 07:03:02 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:03:02 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:03:02 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:03:02 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:03:02 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:03:02 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:03:02 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:03:02 user nova-compute[72803]:       <nova:owner>
Aug 15 07:03:02 user nova-compute[72803]:         <nova:user uuid="701c79552e3044d0babde5510a994efa">tempest-ServerActionsTestOtherB-1808789614-project-member</nova:user>
Aug 15 07:03:02 user nova-compute[72803]:         <nova:project uuid="3de2e755df9744d59e93c26feeec4ebf">tempest-ServerActionsTestOtherB-1808789614</nova:project>
Aug 15 07:03:02 user nova-compute[72803]:       </nova:owner>
Aug 15 07:03:02 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:03:02 user nova-compute[72803]:       <nova:ports>
Aug 15 07:03:02 user nova-compute[72803]:         <nova:port uuid="89d1c280-dac6-41fa-8fb1-0d1b31c21f10">
Aug 15 07:03:02 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 07:03:02 user nova-compute[72803]:         </nova:port>
Aug 15 07:03:02 user nova-compute[72803]:       </nova:ports>
Aug 15 07:03:02 user nova-compute[72803]:     </nova:instance>
Aug 15 07:03:02 user nova-compute[72803]:   </metadata>
Aug 15 07:03:02 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:03:02 user nova-compute[72803]:     <system>
Aug 15 07:03:02 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:03:02 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:03:02 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:03:02 user nova-compute[72803]:       <entry name="serial">ae246e06-40b2-4c05-a7b7-63f016a8ea03</entry>
Aug 15 07:03:02 user nova-compute[72803]:       <entry name="uuid">ae246e06-40b2-4c05-a7b7-63f016a8ea03</entry>
Aug 15 07:03:02 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:03:02 user nova-compute[72803]:     </system>
Aug 15 07:03:02 user nova-compute[72803]:   </sysinfo>
Aug 15 07:03:02 user nova-compute[72803]:   <os>
Aug 15 07:03:02 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:03:02 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:03:02 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:03:02 user nova-compute[72803]:   </os>
Aug 15 07:03:02 user nova-compute[72803]:   <features>
Aug 15 07:03:02 user nova-compute[72803]:     <acpi/>
Aug 15 07:03:02 user nova-compute[72803]:     <apic/>
Aug 15 07:03:02 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:03:02 user nova-compute[72803]:   </features>
Aug 15 07:03:02 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:03:02 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:03:02 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:03:02 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:03:02 user nova-compute[72803]:   </clock>
Aug 15 07:03:02 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:03:02 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:03:02 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:03:02 user nova-compute[72803]:   </cpu>
Aug 15 07:03:02 user nova-compute[72803]:   <devices>
Aug 15 07:03:02 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:03:02 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:03:02 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk"/>
Aug 15 07:03:02 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:03:02 user nova-compute[72803]:     </disk>
Aug 15 07:03:02 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:03:02 user nova-compute[72803]:       <mac address="fa:16:3e:32:4e:18"/>
Aug 15 07:03:02 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:02 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:03:02 user nova-compute[72803]:       <target dev="tap89d1c280-da"/>
Aug 15 07:03:02 user nova-compute[72803]:     </interface>
Aug 15 07:03:02 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:03:02 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/console.log" append="off"/>
Aug 15 07:03:02 user nova-compute[72803]:     </serial>
Aug 15 07:03:02 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:03:02 user nova-compute[72803]:     <video>
Aug 15 07:03:02 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:02 user nova-compute[72803]:     </video>
Aug 15 07:03:02 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:03:02 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:03:02 user nova-compute[72803]:     </rng>
Aug 15 07:03:02 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:03:02 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:03:02 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:03:02 user nova-compute[72803]:     </memballoon>
Aug 15 07:03:02 user nova-compute[72803]:   </devices>
Aug 15 07:03:02 user nova-compute[72803]: </domain>
Aug 15 07:03:02 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG os_vif [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89d1c280-da, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89d1c280-da, col_values=(('external_ids', {'iface-id': '89d1c280-dac6-41fa-8fb1-0d1b31c21f10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:4e:18', 'vm-uuid': 'ae246e06-40b2-4c05-a7b7-63f016a8ea03'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:02 user nova-compute[72803]: INFO os_vif [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da')
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] No VIF found with MAC fa:16:3e:32:4e:18, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.network.neutron [req-a4508802-33d5-4b90-ac03-a7298e735e34 req-39235f87-cec8-452f-ae50-6d622fe435ca service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updated VIF entry in instance network info cache for port 89d1c280-dac6-41fa-8fb1-0d1b31c21f10. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG nova.network.neutron [req-a4508802-33d5-4b90-ac03-a7298e735e34 req-39235f87-cec8-452f-ae50-6d622fe435ca service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4508802-33d5-4b90-ac03-a7298e735e34 req-39235f87-cec8-452f-ae50-6d622fe435ca service nova] Releasing lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "52b19720-9992-4994-ab65-aae046dcfc54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "52b19720-9992-4994-ab65-aae046dcfc54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:03:04 user nova-compute[72803]: INFO nova.compute.claims [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Claim successful on node user
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-e35e4aaf-d913-45ef-b834-4f8712a5e44a req-deb74ecb-f8ac-4a8a-9ed6-602e8f9cf9e4 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e35e4aaf-d913-45ef-b834-4f8712a5e44a req-deb74ecb-f8ac-4a8a-9ed6-602e8f9cf9e4 service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e35e4aaf-d913-45ef-b834-4f8712a5e44a req-deb74ecb-f8ac-4a8a-9ed6-602e8f9cf9e4 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e35e4aaf-d913-45ef-b834-4f8712a5e44a req-deb74ecb-f8ac-4a8a-9ed6-602e8f9cf9e4 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-e35e4aaf-d913-45ef-b834-4f8712a5e44a req-deb74ecb-f8ac-4a8a-9ed6-602e8f9cf9e4 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:04 user nova-compute[72803]: WARNING nova.compute.manager [req-e35e4aaf-d913-45ef-b834-4f8712a5e44a req-deb74ecb-f8ac-4a8a-9ed6-602e8f9cf9e4 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state building and task_state spawning.
Aug 15 07:03:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:03:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:03:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:03:05 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Creating image(s)
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "/opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "/opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "/opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG nova.policy [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50aff8fa1c354f4ea9a049f7d7671766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05b597754cfb485e932dd63026e40104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.233s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.286s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk 1073741824" returned: 0 in 0.222s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.518s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.271s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-c8e14e60-c238-4e4e-b1f9-65296cac03e0 req-ebee161d-942c-48f6-950e-eab72ed5b174 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8e14e60-c238-4e4e-b1f9-65296cac03e0 req-ebee161d-942c-48f6-950e-eab72ed5b174 service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8e14e60-c238-4e4e-b1f9-65296cac03e0 req-ebee161d-942c-48f6-950e-eab72ed5b174 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8e14e60-c238-4e4e-b1f9-65296cac03e0 req-ebee161d-942c-48f6-950e-eab72ed5b174 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-c8e14e60-c238-4e4e-b1f9-65296cac03e0 req-ebee161d-942c-48f6-950e-eab72ed5b174 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:06 user nova-compute[72803]: WARNING nova.compute.manager [req-c8e14e60-c238-4e4e-b1f9-65296cac03e0 req-ebee161d-942c-48f6-950e-eab72ed5b174 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state building and task_state spawning.
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:03:06 user nova-compute[72803]: INFO nova.compute.claims [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Claim successful on node user
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Cannot resize image /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lazy-loading 'migration_context' on Instance uuid 52b19720-9992-4994-ab65-aae046dcfc54 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Ensure instance console log exists: /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082986.6525867, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:06 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Resumed (Lifecycle Event)
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance spawned successfully.
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:06 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082986.6550028, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:06 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Started (Lifecycle Event)
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Successfully created port: fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:03:06 user nova-compute[72803]: INFO nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Took 7.38 seconds to spawn the instance on the hypervisor.
Aug 15 07:03:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:07 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:07 user nova-compute[72803]: INFO nova.compute.manager [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Took 8.39 seconds to build instance.
Aug 15 07:03:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-08024a74-ebfa-4246-9af9-5dba16115cc8 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.566s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:03:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.policy [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35a29bfde8d746f9b15c12e31a925c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7937188c3cb441fa4f4348d2e3b2573', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:03:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Creating image(s)
Aug 15 07:03:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.279s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.251s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Successfully updated port: fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk 1073741824" returned: 0 in 0.076s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "refresh_cache-52b19720-9992-4994-ab65-aae046dcfc54" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquired lock "refresh_cache-52b19720-9992-4994-ab65-aae046dcfc54" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-2464cb6f-8d1c-4d2d-9c1a-b9e7bac79094 req-cd1096d5-3040-49c4-bb3d-0e00db0bcc91 service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received event network-changed-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-2464cb6f-8d1c-4d2d-9c1a-b9e7bac79094 req-cd1096d5-3040-49c4-bb3d-0e00db0bcc91 service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Refreshing instance network info cache due to event network-changed-fa4426ff-007f-478a-a489-d61778f916a7. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2464cb6f-8d1c-4d2d-9c1a-b9e7bac79094 req-cd1096d5-3040-49c4-bb3d-0e00db0bcc91 service nova] Acquiring lock "refresh_cache-52b19720-9992-4994-ab65-aae046dcfc54" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.290s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Successfully created port: 390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Cannot resize image /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:03:08 user nova-compute[72803]: DEBUG nova.objects.instance [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'migration_context' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Ensure instance console log exists: /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Updating instance_info_cache with network_info: [{"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Releasing lock "refresh_cache-52b19720-9992-4994-ab65-aae046dcfc54" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Instance network_info: |[{"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2464cb6f-8d1c-4d2d-9c1a-b9e7bac79094 req-cd1096d5-3040-49c4-bb3d-0e00db0bcc91 service nova] Acquired lock "refresh_cache-52b19720-9992-4994-ab65-aae046dcfc54" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-2464cb6f-8d1c-4d2d-9c1a-b9e7bac79094 req-cd1096d5-3040-49c4-bb3d-0e00db0bcc91 service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Refreshing network info cache for port fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Start _get_guest_xml network_info=[{"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:03:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-336339215',display_name='tempest-VolumesNegativeTest-instance-336339215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-336339215',id=22,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05b597754cfb485e932dd63026e40104',ramdisk_id='',reservation_id='r-kjft9xxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2017874458',owner_user_name='tempest-VolumesNegativeTest-2017874458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:05Z,user_data=None,user_id='50aff8fa1c354f4ea9a049f7d7671766',uuid=52b19720-9992-4994-ab65-aae046dcfc54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Converting VIF {"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fa4426ff-007f-478a-a489-d61778f916a7,network=Network(3049574f-5d5d-4d03-aa10-9377cc7e6b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4426ff-00') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lazy-loading 'pci_devices' on Instance uuid 52b19720-9992-4994-ab65-aae046dcfc54 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:03:09 user nova-compute[72803]:   <uuid>52b19720-9992-4994-ab65-aae046dcfc54</uuid>
Aug 15 07:03:09 user nova-compute[72803]:   <name>instance-00000016</name>
Aug 15 07:03:09 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:03:09 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:03:09 user nova-compute[72803]:   <metadata>
Aug 15 07:03:09 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:03:09 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:03:09 user nova-compute[72803]:       <nova:name>tempest-VolumesNegativeTest-instance-336339215</nova:name>
Aug 15 07:03:09 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:03:09</nova:creationTime>
Aug 15 07:03:09 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:03:09 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:03:09 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:03:09 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:03:09 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:03:09 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:03:09 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:03:09 user nova-compute[72803]:       <nova:owner>
Aug 15 07:03:09 user nova-compute[72803]:         <nova:user uuid="50aff8fa1c354f4ea9a049f7d7671766">tempest-VolumesNegativeTest-2017874458-project-member</nova:user>
Aug 15 07:03:09 user nova-compute[72803]:         <nova:project uuid="05b597754cfb485e932dd63026e40104">tempest-VolumesNegativeTest-2017874458</nova:project>
Aug 15 07:03:09 user nova-compute[72803]:       </nova:owner>
Aug 15 07:03:09 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:03:09 user nova-compute[72803]:       <nova:ports>
Aug 15 07:03:09 user nova-compute[72803]:         <nova:port uuid="fa4426ff-007f-478a-a489-d61778f916a7">
Aug 15 07:03:09 user nova-compute[72803]:           <nova:ip type="fixed" address="192.168.233.128" ipVersion="4"/>
Aug 15 07:03:09 user nova-compute[72803]:         </nova:port>
Aug 15 07:03:09 user nova-compute[72803]:       </nova:ports>
Aug 15 07:03:09 user nova-compute[72803]:     </nova:instance>
Aug 15 07:03:09 user nova-compute[72803]:   </metadata>
Aug 15 07:03:09 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:03:09 user nova-compute[72803]:     <system>
Aug 15 07:03:09 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:03:09 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:03:09 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:03:09 user nova-compute[72803]:       <entry name="serial">52b19720-9992-4994-ab65-aae046dcfc54</entry>
Aug 15 07:03:09 user nova-compute[72803]:       <entry name="uuid">52b19720-9992-4994-ab65-aae046dcfc54</entry>
Aug 15 07:03:09 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:03:09 user nova-compute[72803]:     </system>
Aug 15 07:03:09 user nova-compute[72803]:   </sysinfo>
Aug 15 07:03:09 user nova-compute[72803]:   <os>
Aug 15 07:03:09 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:03:09 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:03:09 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:03:09 user nova-compute[72803]:   </os>
Aug 15 07:03:09 user nova-compute[72803]:   <features>
Aug 15 07:03:09 user nova-compute[72803]:     <acpi/>
Aug 15 07:03:09 user nova-compute[72803]:     <apic/>
Aug 15 07:03:09 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:03:09 user nova-compute[72803]:   </features>
Aug 15 07:03:09 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:03:09 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:03:09 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:03:09 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:03:09 user nova-compute[72803]:   </clock>
Aug 15 07:03:09 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:03:09 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:03:09 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:03:09 user nova-compute[72803]:   </cpu>
Aug 15 07:03:09 user nova-compute[72803]:   <devices>
Aug 15 07:03:09 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:03:09 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:03:09 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk"/>
Aug 15 07:03:09 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:03:09 user nova-compute[72803]:     </disk>
Aug 15 07:03:09 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:03:09 user nova-compute[72803]:       <mac address="fa:16:3e:52:c4:07"/>
Aug 15 07:03:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:09 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:03:09 user nova-compute[72803]:       <target dev="tapfa4426ff-00"/>
Aug 15 07:03:09 user nova-compute[72803]:     </interface>
Aug 15 07:03:09 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:03:09 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/console.log" append="off"/>
Aug 15 07:03:09 user nova-compute[72803]:     </serial>
Aug 15 07:03:09 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:03:09 user nova-compute[72803]:     <video>
Aug 15 07:03:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:09 user nova-compute[72803]:     </video>
Aug 15 07:03:09 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:03:09 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:03:09 user nova-compute[72803]:     </rng>
Aug 15 07:03:09 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:03:09 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:03:09 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:03:09 user nova-compute[72803]:     </memballoon>
Aug 15 07:03:09 user nova-compute[72803]:   </devices>
Aug 15 07:03:09 user nova-compute[72803]: </domain>
Aug 15 07:03:09 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-336339215',display_name='tempest-VolumesNegativeTest-instance-336339215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-336339215',id=22,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05b597754cfb485e932dd63026e40104',ramdisk_id='',reservation_id='r-kjft9xxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2017874458',owner_user_name='tempest-VolumesNegativeTest-2017874458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:05Z,user_data=None,user_id='50aff8fa1c354f4ea9a049f7d7671766',uuid=52b19720-9992-4994-ab65-aae046dcfc54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Converting VIF {"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fa4426ff-007f-478a-a489-d61778f916a7,network=Network(3049574f-5d5d-4d03-aa10-9377cc7e6b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4426ff-00') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG os_vif [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fa4426ff-007f-478a-a489-d61778f916a7,network=Network(3049574f-5d5d-4d03-aa10-9377cc7e6b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4426ff-00') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa4426ff-00, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa4426ff-00, col_values=(('external_ids', {'iface-id': 'fa4426ff-007f-478a-a489-d61778f916a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:c4:07', 'vm-uuid': '52b19720-9992-4994-ab65-aae046dcfc54'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:09 user nova-compute[72803]: INFO os_vif [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fa4426ff-007f-478a-a489-d61778f916a7,network=Network(3049574f-5d5d-4d03-aa10-9377cc7e6b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4426ff-00')
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] No VIF found with MAC fa:16:3e:52:c4:07, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-2464cb6f-8d1c-4d2d-9c1a-b9e7bac79094 req-cd1096d5-3040-49c4-bb3d-0e00db0bcc91 service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Updated VIF entry in instance network info cache for port fa4426ff-007f-478a-a489-d61778f916a7. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-2464cb6f-8d1c-4d2d-9c1a-b9e7bac79094 req-cd1096d5-3040-49c4-bb3d-0e00db0bcc91 service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Updating instance_info_cache with network_info: [{"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2464cb6f-8d1c-4d2d-9c1a-b9e7bac79094 req-cd1096d5-3040-49c4-bb3d-0e00db0bcc91 service nova] Releasing lock "refresh_cache-52b19720-9992-4994-ab65-aae046dcfc54" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Successfully updated port: 390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquired lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-00606887-8c39-4fd1-91c3-3f190436bf6e req-b1442974-fff6-43fa-adca-726beb23ef1e service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-changed-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-00606887-8c39-4fd1-91c3-3f190436bf6e req-b1442974-fff6-43fa-adca-726beb23ef1e service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Refreshing instance network info cache due to event network-changed-390036c0-19a4-46bf-9e26-a90cdb1e2333. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-00606887-8c39-4fd1-91c3-3f190436bf6e req-b1442974-fff6-43fa-adca-726beb23ef1e service nova] Acquiring lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.network.neutron [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updating instance_info_cache with network_info: [{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Releasing lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance network_info: |[{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-00606887-8c39-4fd1-91c3-3f190436bf6e req-b1442974-fff6-43fa-adca-726beb23ef1e service nova] Acquired lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-00606887-8c39-4fd1-91c3-3f190436bf6e req-b1442974-fff6-43fa-adca-726beb23ef1e service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Refreshing network info cache for port 390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Start _get_guest_xml network_info=[{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:03:10 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:10 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1958541110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1958541110',id=23,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv0b0a3ngqM1Rw6ivElDPxaHZTqoncXJY7HEghPOJHNLnPbdeaVX6ny+VQEQQqKJjEj171XZaFPBboIGN/GYnEdB2Fl2X0k60YoU4I4StHZ2sd7s/Pu8YkH906fueCb3w==',key_name='tempest-keypair-312287039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-nt0tdef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=56b3f17c-680b-4cbc-ad5a-26ec9f4ee154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'pci_devices' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:03:10 user nova-compute[72803]:   <uuid>56b3f17c-680b-4cbc-ad5a-26ec9f4ee154</uuid>
Aug 15 07:03:10 user nova-compute[72803]:   <name>instance-00000017</name>
Aug 15 07:03:10 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:03:10 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:03:10 user nova-compute[72803]:   <metadata>
Aug 15 07:03:10 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:03:10 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:03:10 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1958541110</nova:name>
Aug 15 07:03:10 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:03:10</nova:creationTime>
Aug 15 07:03:10 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:03:10 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:03:10 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:03:10 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:03:10 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:03:10 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:03:10 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:03:10 user nova-compute[72803]:       <nova:owner>
Aug 15 07:03:10 user nova-compute[72803]:         <nova:user uuid="35a29bfde8d746f9b15c12e31a925c47">tempest-AttachVolumeShelveTestJSON-758519316-project-member</nova:user>
Aug 15 07:03:10 user nova-compute[72803]:         <nova:project uuid="f7937188c3cb441fa4f4348d2e3b2573">tempest-AttachVolumeShelveTestJSON-758519316</nova:project>
Aug 15 07:03:10 user nova-compute[72803]:       </nova:owner>
Aug 15 07:03:10 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:03:10 user nova-compute[72803]:       <nova:ports>
Aug 15 07:03:10 user nova-compute[72803]:         <nova:port uuid="390036c0-19a4-46bf-9e26-a90cdb1e2333">
Aug 15 07:03:10 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:03:10 user nova-compute[72803]:         </nova:port>
Aug 15 07:03:10 user nova-compute[72803]:       </nova:ports>
Aug 15 07:03:10 user nova-compute[72803]:     </nova:instance>
Aug 15 07:03:10 user nova-compute[72803]:   </metadata>
Aug 15 07:03:10 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:03:10 user nova-compute[72803]:     <system>
Aug 15 07:03:10 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:03:10 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:03:10 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:03:10 user nova-compute[72803]:       <entry name="serial">56b3f17c-680b-4cbc-ad5a-26ec9f4ee154</entry>
Aug 15 07:03:10 user nova-compute[72803]:       <entry name="uuid">56b3f17c-680b-4cbc-ad5a-26ec9f4ee154</entry>
Aug 15 07:03:10 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:03:10 user nova-compute[72803]:     </system>
Aug 15 07:03:10 user nova-compute[72803]:   </sysinfo>
Aug 15 07:03:10 user nova-compute[72803]:   <os>
Aug 15 07:03:10 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:03:10 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:03:10 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:03:10 user nova-compute[72803]:   </os>
Aug 15 07:03:10 user nova-compute[72803]:   <features>
Aug 15 07:03:10 user nova-compute[72803]:     <acpi/>
Aug 15 07:03:10 user nova-compute[72803]:     <apic/>
Aug 15 07:03:10 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:03:10 user nova-compute[72803]:   </features>
Aug 15 07:03:10 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:03:10 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:03:10 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:03:10 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:03:10 user nova-compute[72803]:   </clock>
Aug 15 07:03:10 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:03:10 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:03:10 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:03:10 user nova-compute[72803]:   </cpu>
Aug 15 07:03:10 user nova-compute[72803]:   <devices>
Aug 15 07:03:10 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:03:10 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:03:10 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk"/>
Aug 15 07:03:10 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:03:10 user nova-compute[72803]:     </disk>
Aug 15 07:03:10 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:03:10 user nova-compute[72803]:       <mac address="fa:16:3e:ae:4f:86"/>
Aug 15 07:03:10 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:10 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:03:10 user nova-compute[72803]:       <target dev="tap390036c0-19"/>
Aug 15 07:03:10 user nova-compute[72803]:     </interface>
Aug 15 07:03:10 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:03:10 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/console.log" append="off"/>
Aug 15 07:03:10 user nova-compute[72803]:     </serial>
Aug 15 07:03:10 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:03:10 user nova-compute[72803]:     <video>
Aug 15 07:03:10 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:10 user nova-compute[72803]:     </video>
Aug 15 07:03:10 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:03:10 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:03:10 user nova-compute[72803]:     </rng>
Aug 15 07:03:10 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:03:10 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:03:10 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:03:10 user nova-compute[72803]:     </memballoon>
Aug 15 07:03:10 user nova-compute[72803]:   </devices>
Aug 15 07:03:10 user nova-compute[72803]: </domain>
Aug 15 07:03:10 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1958541110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1958541110',id=23,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv0b0a3ngqM1Rw6ivElDPxaHZTqoncXJY7HEghPOJHNLnPbdeaVX6ny+VQEQQqKJjEj171XZaFPBboIGN/GYnEdB2Fl2X0k60YoU4I4StHZ2sd7s/Pu8YkH906fueCb3w==',key_name='tempest-keypair-312287039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-nt0tdef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=56b3f17c-680b-4cbc-ad5a-26ec9f4ee154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG os_vif [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap390036c0-19, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap390036c0-19, col_values=(('external_ids', {'iface-id': '390036c0-19a4-46bf-9e26-a90cdb1e2333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:4f:86', 'vm-uuid': '56b3f17c-680b-4cbc-ad5a-26ec9f4ee154'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:10 user nova-compute[72803]: INFO os_vif [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19')
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:03:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No VIF found with MAC fa:16:3e:ae:4f:86, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-8488ca54-c667-46c6-a545-3f8646c245d9 req-04fdc121-0bf0-4b4a-b2c0-18a0183fadfc service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received event network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8488ca54-c667-46c6-a545-3f8646c245d9 req-04fdc121-0bf0-4b4a-b2c0-18a0183fadfc service nova] Acquiring lock "52b19720-9992-4994-ab65-aae046dcfc54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8488ca54-c667-46c6-a545-3f8646c245d9 req-04fdc121-0bf0-4b4a-b2c0-18a0183fadfc service nova] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8488ca54-c667-46c6-a545-3f8646c245d9 req-04fdc121-0bf0-4b4a-b2c0-18a0183fadfc service nova] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-8488ca54-c667-46c6-a545-3f8646c245d9 req-04fdc121-0bf0-4b4a-b2c0-18a0183fadfc service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] No waiting events found dispatching network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:11 user nova-compute[72803]: WARNING nova.compute.manager [req-8488ca54-c667-46c6-a545-3f8646c245d9 req-04fdc121-0bf0-4b4a-b2c0-18a0183fadfc service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received unexpected event network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 for instance with vm_state building and task_state spawning.
Aug 15 07:03:11 user nova-compute[72803]: DEBUG nova.network.neutron [req-00606887-8c39-4fd1-91c3-3f190436bf6e req-b1442974-fff6-43fa-adca-726beb23ef1e service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updated VIF entry in instance network info cache for port 390036c0-19a4-46bf-9e26-a90cdb1e2333. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG nova.network.neutron [req-00606887-8c39-4fd1-91c3-3f190436bf6e req-b1442974-fff6-43fa-adca-726beb23ef1e service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updating instance_info_cache with network_info: [{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-00606887-8c39-4fd1-91c3-3f190436bf6e req-b1442974-fff6-43fa-adca-726beb23ef1e service nova] Releasing lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received event network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] Acquiring lock "52b19720-9992-4994-ab65-aae046dcfc54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] No waiting events found dispatching network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:13 user nova-compute[72803]: WARNING nova.compute.manager [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received unexpected event network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 for instance with vm_state building and task_state spawning.
Aug 15 07:03:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] No waiting events found dispatching network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:13 user nova-compute[72803]: WARNING nova.compute.manager [req-cb304f3e-a47d-451f-a7fa-6c56f2b14dea req-9c934b0e-6ac1-4f7e-8d2e-0c7ba8906a4a service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received unexpected event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 for instance with vm_state building and task_state spawning.
Aug 15 07:03:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082994.8677423, 52b19720-9992-4994-ab65-aae046dcfc54 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] VM Resumed (Lifecycle Event)
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Instance spawned successfully.
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082994.8699539, 52b19720-9992-4994-ab65-aae046dcfc54 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] VM Started (Lifecycle Event)
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Took 9.82 seconds to spawn the instance on the hypervisor.
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.compute.manager [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Took 10.97 seconds to build instance.
Aug 15 07:03:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f98ca229-1639-4a27-99bc-81fd61ea010a tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "52b19720-9992-4994-ab65-aae046dcfc54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.128s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082995.4109242, 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] VM Resumed (Lifecycle Event)
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance spawned successfully.
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692082995.4111786, 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] VM Started (Lifecycle Event)
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Took 7.83 seconds to spawn the instance on the hypervisor.
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c2fb53d-a1c7-4506-aff7-6561f11cef43 req-8d0c6e90-16a5-4d10-89c0-cb9b38cbceff service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c2fb53d-a1c7-4506-aff7-6561f11cef43 req-8d0c6e90-16a5-4d10-89c0-cb9b38cbceff service nova] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c2fb53d-a1c7-4506-aff7-6561f11cef43 req-8d0c6e90-16a5-4d10-89c0-cb9b38cbceff service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c2fb53d-a1c7-4506-aff7-6561f11cef43 req-8d0c6e90-16a5-4d10-89c0-cb9b38cbceff service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c2fb53d-a1c7-4506-aff7-6561f11cef43 req-8d0c6e90-16a5-4d10-89c0-cb9b38cbceff service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] No waiting events found dispatching network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:15 user nova-compute[72803]: WARNING nova.compute.manager [req-4c2fb53d-a1c7-4506-aff7-6561f11cef43 req-8d0c6e90-16a5-4d10-89c0-cb9b38cbceff service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received unexpected event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 for instance with vm_state building and task_state spawning.
Aug 15 07:03:15 user nova-compute[72803]: INFO nova.compute.manager [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Took 9.33 seconds to build instance.
Aug 15 07:03:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-20d9cc24-bcbb-4475-87d9-c2ee8c39618e tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.512s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:03:30 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:34 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:03:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:34 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:03:35 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:03:35 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "bd737048-02f4-4dc3-b386-202d96fd5425" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "bd737048-02f4-4dc3-b386-202d96fd5425" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:03:36 user nova-compute[72803]: INFO nova.compute.claims [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Claim successful on node user
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.045s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.network.neutron [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:03:36 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.policy [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3529639076634804b4bee814a03fc2c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be5a3574f4f34ed0be6736c3f3bfc593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:03:36 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Creating image(s)
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "/opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "/opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.031s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk 1073741824" returned: 0 in 0.056s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Cannot resize image /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG nova.objects.instance [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lazy-loading 'migration_context' on Instance uuid bd737048-02f4-4dc3-b386-202d96fd5425 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Ensure instance console log exists: /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Successfully created port: e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:03:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Successfully updated port: e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "refresh_cache-bd737048-02f4-4dc3-b386-202d96fd5425" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquired lock "refresh_cache-bd737048-02f4-4dc3-b386-202d96fd5425" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-33f8d379-ab61-4ae9-ac87-8b222473e5eb req-5588c1ca-32f7-4bdc-801b-d64b62da1aa7 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received event network-changed-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-33f8d379-ab61-4ae9-ac87-8b222473e5eb req-5588c1ca-32f7-4bdc-801b-d64b62da1aa7 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Refreshing instance network info cache due to event network-changed-e8468a36-f4d4-44e8-8140-e6117dcb3338. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33f8d379-ab61-4ae9-ac87-8b222473e5eb req-5588c1ca-32f7-4bdc-801b-d64b62da1aa7 service nova] Acquiring lock "refresh_cache-bd737048-02f4-4dc3-b386-202d96fd5425" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:03:39 user nova-compute[72803]: INFO nova.compute.claims [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Claim successful on node user
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Updating instance_info_cache with network_info: [{"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Releasing lock "refresh_cache-bd737048-02f4-4dc3-b386-202d96fd5425" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Instance network_info: |[{"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33f8d379-ab61-4ae9-ac87-8b222473e5eb req-5588c1ca-32f7-4bdc-801b-d64b62da1aa7 service nova] Acquired lock "refresh_cache-bd737048-02f4-4dc3-b386-202d96fd5425" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.network.neutron [req-33f8d379-ab61-4ae9-ac87-8b222473e5eb req-5588c1ca-32f7-4bdc-801b-d64b62da1aa7 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Refreshing network info cache for port e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Start _get_guest_xml network_info=[{"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:03:39 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:39 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-883257000',display_name='tempest-VolumesActionsTest-instance-883257000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-883257000',id=24,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be5a3574f4f34ed0be6736c3f3bfc593',ramdisk_id='',reservation_id='r-0bkzivvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-171960212',owner_user_name='tempest-VolumesActionsTest-171960212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:37Z,user_data=None,user_id='3529639076634804b4bee814a03fc2c2',uuid=bd737048-02f4-4dc3-b386-202d96fd5425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Converting VIF {"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:84:2c,bridge_name='br-int',has_traffic_filtering=True,id=e8468a36-f4d4-44e8-8140-e6117dcb3338,network=Network(cedc471c-bac3-45bc-9ce9-460effcf98ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8468a36-f4') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.objects.instance [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lazy-loading 'pci_devices' on Instance uuid bd737048-02f4-4dc3-b386-202d96fd5425 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:03:39 user nova-compute[72803]:   <uuid>bd737048-02f4-4dc3-b386-202d96fd5425</uuid>
Aug 15 07:03:39 user nova-compute[72803]:   <name>instance-00000018</name>
Aug 15 07:03:39 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:03:39 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:03:39 user nova-compute[72803]:   <metadata>
Aug 15 07:03:39 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:03:39 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:03:39 user nova-compute[72803]:       <nova:name>tempest-VolumesActionsTest-instance-883257000</nova:name>
Aug 15 07:03:39 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:03:39</nova:creationTime>
Aug 15 07:03:39 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:03:39 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:03:39 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:03:39 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:03:39 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:03:39 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:03:39 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:03:39 user nova-compute[72803]:       <nova:owner>
Aug 15 07:03:39 user nova-compute[72803]:         <nova:user uuid="3529639076634804b4bee814a03fc2c2">tempest-VolumesActionsTest-171960212-project-member</nova:user>
Aug 15 07:03:39 user nova-compute[72803]:         <nova:project uuid="be5a3574f4f34ed0be6736c3f3bfc593">tempest-VolumesActionsTest-171960212</nova:project>
Aug 15 07:03:39 user nova-compute[72803]:       </nova:owner>
Aug 15 07:03:39 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:03:39 user nova-compute[72803]:       <nova:ports>
Aug 15 07:03:39 user nova-compute[72803]:         <nova:port uuid="e8468a36-f4d4-44e8-8140-e6117dcb3338">
Aug 15 07:03:39 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 07:03:39 user nova-compute[72803]:         </nova:port>
Aug 15 07:03:39 user nova-compute[72803]:       </nova:ports>
Aug 15 07:03:39 user nova-compute[72803]:     </nova:instance>
Aug 15 07:03:39 user nova-compute[72803]:   </metadata>
Aug 15 07:03:39 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:03:39 user nova-compute[72803]:     <system>
Aug 15 07:03:39 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:03:39 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:03:39 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:03:39 user nova-compute[72803]:       <entry name="serial">bd737048-02f4-4dc3-b386-202d96fd5425</entry>
Aug 15 07:03:39 user nova-compute[72803]:       <entry name="uuid">bd737048-02f4-4dc3-b386-202d96fd5425</entry>
Aug 15 07:03:39 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:03:39 user nova-compute[72803]:     </system>
Aug 15 07:03:39 user nova-compute[72803]:   </sysinfo>
Aug 15 07:03:39 user nova-compute[72803]:   <os>
Aug 15 07:03:39 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:03:39 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:03:39 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:03:39 user nova-compute[72803]:   </os>
Aug 15 07:03:39 user nova-compute[72803]:   <features>
Aug 15 07:03:39 user nova-compute[72803]:     <acpi/>
Aug 15 07:03:39 user nova-compute[72803]:     <apic/>
Aug 15 07:03:39 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:03:39 user nova-compute[72803]:   </features>
Aug 15 07:03:39 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:03:39 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:03:39 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:03:39 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:03:39 user nova-compute[72803]:   </clock>
Aug 15 07:03:39 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:03:39 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:03:39 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:03:39 user nova-compute[72803]:   </cpu>
Aug 15 07:03:39 user nova-compute[72803]:   <devices>
Aug 15 07:03:39 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:03:39 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:03:39 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk"/>
Aug 15 07:03:39 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:03:39 user nova-compute[72803]:     </disk>
Aug 15 07:03:39 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:03:39 user nova-compute[72803]:       <mac address="fa:16:3e:9f:84:2c"/>
Aug 15 07:03:39 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:39 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:03:39 user nova-compute[72803]:       <target dev="tape8468a36-f4"/>
Aug 15 07:03:39 user nova-compute[72803]:     </interface>
Aug 15 07:03:39 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:03:39 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/console.log" append="off"/>
Aug 15 07:03:39 user nova-compute[72803]:     </serial>
Aug 15 07:03:39 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:03:39 user nova-compute[72803]:     <video>
Aug 15 07:03:39 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:39 user nova-compute[72803]:     </video>
Aug 15 07:03:39 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:03:39 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:03:39 user nova-compute[72803]:     </rng>
Aug 15 07:03:39 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:03:39 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:03:39 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:03:39 user nova-compute[72803]:     </memballoon>
Aug 15 07:03:39 user nova-compute[72803]:   </devices>
Aug 15 07:03:39 user nova-compute[72803]: </domain>
Aug 15 07:03:39 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-883257000',display_name='tempest-VolumesActionsTest-instance-883257000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-883257000',id=24,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be5a3574f4f34ed0be6736c3f3bfc593',ramdisk_id='',reservation_id='r-0bkzivvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-171960212',owner_user_name='tempest-VolumesActionsTest-171960212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:37Z,user_data=None,user_id='3529639076634804b4bee814a03fc2c2',uuid=bd737048-02f4-4dc3-b386-202d96fd5425,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Converting VIF {"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:84:2c,bridge_name='br-int',has_traffic_filtering=True,id=e8468a36-f4d4-44e8-8140-e6117dcb3338,network=Network(cedc471c-bac3-45bc-9ce9-460effcf98ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8468a36-f4') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG os_vif [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:84:2c,bridge_name='br-int',has_traffic_filtering=True,id=e8468a36-f4d4-44e8-8140-e6117dcb3338,network=Network(cedc471c-bac3-45bc-9ce9-460effcf98ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8468a36-f4') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8468a36-f4, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8468a36-f4, col_values=(('external_ids', {'iface-id': 'e8468a36-f4d4-44e8-8140-e6117dcb3338', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:84:2c', 'vm-uuid': 'bd737048-02f4-4dc3-b386-202d96fd5425'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:39 user nova-compute[72803]: INFO os_vif [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:84:2c,bridge_name='br-int',has_traffic_filtering=True,id=e8468a36-f4d4-44e8-8140-e6117dcb3338,network=Network(cedc471c-bac3-45bc-9ce9-460effcf98ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8468a36-f4')
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] No VIF found with MAC fa:16:3e:9f:84:2c, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:03:39 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.792s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:03:40 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:03:40 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-33f8d379-ab61-4ae9-ac87-8b222473e5eb req-5588c1ca-32f7-4bdc-801b-d64b62da1aa7 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Updated VIF entry in instance network info cache for port e8468a36-f4d4-44e8-8140-e6117dcb3338. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-33f8d379-ab61-4ae9-ac87-8b222473e5eb req-5588c1ca-32f7-4bdc-801b-d64b62da1aa7 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Updating instance_info_cache with network_info: [{"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33f8d379-ab61-4ae9-ac87-8b222473e5eb req-5588c1ca-32f7-4bdc-801b-d64b62da1aa7 service nova] Releasing lock "refresh_cache-bd737048-02f4-4dc3-b386-202d96fd5425" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.policy [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c445be5492b44a4ac0ab0ffb9bf6b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415992ab9c124f2db890795802e64ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083023.503514, bd737048-02f4-4dc3-b386-202d96fd5425 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] VM Resumed (Lifecycle Event)
Aug 15 07:03:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:03:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Creating image(s)
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "/opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "/opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "/opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-5e1a3c26-0c2a-4a46-9e4a-27b9673c330b req-dcaf4c22-77e4-46f7-9cbc-af6b5450b918 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received event network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5e1a3c26-0c2a-4a46-9e4a-27b9673c330b req-dcaf4c22-77e4-46f7-9cbc-af6b5450b918 service nova] Acquiring lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5e1a3c26-0c2a-4a46-9e4a-27b9673c330b req-dcaf4c22-77e4-46f7-9cbc-af6b5450b918 service nova] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5e1a3c26-0c2a-4a46-9e4a-27b9673c330b req-dcaf4c22-77e4-46f7-9cbc-af6b5450b918 service nova] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-5e1a3c26-0c2a-4a46-9e4a-27b9673c330b req-dcaf4c22-77e4-46f7-9cbc-af6b5450b918 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] No waiting events found dispatching network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:43 user nova-compute[72803]: WARNING nova.compute.manager [req-5e1a3c26-0c2a-4a46-9e4a-27b9673c330b req-dcaf4c22-77e4-46f7-9cbc-af6b5450b918 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received unexpected event network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 for instance with vm_state building and task_state spawning.
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Instance spawned successfully.
Aug 15 07:03:43 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:43 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7345MB free_disk=25.482799530029297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:03:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083023.5038376, bd737048-02f4-4dc3-b386-202d96fd5425 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] VM Started (Lifecycle Event)
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:44 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:44 user nova-compute[72803]: INFO nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Took 7.27 seconds to spawn the instance on the hypervisor.
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.209s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 06a22c66-fe35-4c52-aef9-9801f38d2832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 506ed7b9-6081-418b-86a8-278db430893e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 52b19720-9992-4994-ab65-aae046dcfc54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance bd737048-02f4-4dc3-b386-202d96fd5425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 59123d08-1213-4b26-865e-8a12efde9744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-ac6e333a-ac78-4a45-93dd-44ab0c3cdd7e req-2107180f-57ba-4e7a-b6f6-a0568e43d1a9 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received event network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac6e333a-ac78-4a45-93dd-44ab0c3cdd7e req-2107180f-57ba-4e7a-b6f6-a0568e43d1a9 service nova] Acquiring lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac6e333a-ac78-4a45-93dd-44ab0c3cdd7e req-2107180f-57ba-4e7a-b6f6-a0568e43d1a9 service nova] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac6e333a-ac78-4a45-93dd-44ab0c3cdd7e req-2107180f-57ba-4e7a-b6f6-a0568e43d1a9 service nova] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-ac6e333a-ac78-4a45-93dd-44ab0c3cdd7e req-2107180f-57ba-4e7a-b6f6-a0568e43d1a9 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] No waiting events found dispatching network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:44 user nova-compute[72803]: WARNING nova.compute.manager [req-ac6e333a-ac78-4a45-93dd-44ab0c3cdd7e req-2107180f-57ba-4e7a-b6f6-a0568e43d1a9 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received unexpected event network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 for instance with vm_state building and task_state spawning.
Aug 15 07:03:44 user nova-compute[72803]: INFO nova.compute.manager [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Took 8.15 seconds to build instance.
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-adfc6b4f-4ed6-45dc-84d8-6b899e76b2bf tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "bd737048-02f4-4dc3-b386-202d96fd5425" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.255s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk 1073741824" returned: 0 in 0.056s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Successfully created port: 0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.812s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Cannot resize image /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'migration_context' on Instance uuid 59123d08-1213-4b26-865e-8a12efde9744 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Ensure instance console log exists: /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Successfully updated port: 0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquired lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-b4eb7ce3-5802-4423-b365-b1aeac602200 req-d19fa359-9753-41fa-95b9-be8ac1f5b571 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-changed-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-b4eb7ce3-5802-4423-b365-b1aeac602200 req-d19fa359-9753-41fa-95b9-be8ac1f5b571 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Refreshing instance network info cache due to event network-changed-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b4eb7ce3-5802-4423-b365-b1aeac602200 req-d19fa359-9753-41fa-95b9-be8ac1f5b571 service nova] Acquiring lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Updating instance_info_cache with network_info: [{"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Releasing lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Instance network_info: |[{"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b4eb7ce3-5802-4423-b365-b1aeac602200 req-d19fa359-9753-41fa-95b9-be8ac1f5b571 service nova] Acquired lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.network.neutron [req-b4eb7ce3-5802-4423-b365-b1aeac602200 req-d19fa359-9753-41fa-95b9-be8ac1f5b571 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Refreshing network info cache for port 0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Start _get_guest_xml network_info=[{"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:03:45 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:45 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:03:45 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-736575719',display_name='tempest-VolumesSnapshotTestJSON-instance-736575719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-736575719',id=25,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeJLaHK92HXJJFMCSV+D3kKEP3kQBRMGMhoBd3/gDUTJVtNl2V6B6IrjUvsejsBLdT+lziTkqLbCmWcHrSFE0672gpHlCDKxv0w4nAU466C2TpuEdjDMHqobvaYthOfDA==',key_name='tempest-keypair-1189402010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415992ab9c124f2db890795802e64ed3',ramdisk_id='',reservation_id='r-1qdp1k7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1700542254',owner_user_name='tempest-VolumesSnapshotTestJSON-1700542254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c445be5492b44a4ac0ab0ffb9bf6b61',uuid=59123d08-1213-4b26-865e-8a12efde9744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converting VIF {"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0f:13,bridge_name='br-int',has_traffic_filtering=True,id=0b2c94f6-afae-4e9d-b856-c8f2c9efe1db,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2c94f6-af') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'pci_devices' on Instance uuid 59123d08-1213-4b26-865e-8a12efde9744 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:03:46 user nova-compute[72803]:   <uuid>59123d08-1213-4b26-865e-8a12efde9744</uuid>
Aug 15 07:03:46 user nova-compute[72803]:   <name>instance-00000019</name>
Aug 15 07:03:46 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:03:46 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:03:46 user nova-compute[72803]:   <metadata>
Aug 15 07:03:46 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:03:46 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:03:46 user nova-compute[72803]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-736575719</nova:name>
Aug 15 07:03:46 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:03:45</nova:creationTime>
Aug 15 07:03:46 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:03:46 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:03:46 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:03:46 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:03:46 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:03:46 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:03:46 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:03:46 user nova-compute[72803]:       <nova:owner>
Aug 15 07:03:46 user nova-compute[72803]:         <nova:user uuid="9c445be5492b44a4ac0ab0ffb9bf6b61">tempest-VolumesSnapshotTestJSON-1700542254-project-member</nova:user>
Aug 15 07:03:46 user nova-compute[72803]:         <nova:project uuid="415992ab9c124f2db890795802e64ed3">tempest-VolumesSnapshotTestJSON-1700542254</nova:project>
Aug 15 07:03:46 user nova-compute[72803]:       </nova:owner>
Aug 15 07:03:46 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:03:46 user nova-compute[72803]:       <nova:ports>
Aug 15 07:03:46 user nova-compute[72803]:         <nova:port uuid="0b2c94f6-afae-4e9d-b856-c8f2c9efe1db">
Aug 15 07:03:46 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 07:03:46 user nova-compute[72803]:         </nova:port>
Aug 15 07:03:46 user nova-compute[72803]:       </nova:ports>
Aug 15 07:03:46 user nova-compute[72803]:     </nova:instance>
Aug 15 07:03:46 user nova-compute[72803]:   </metadata>
Aug 15 07:03:46 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:03:46 user nova-compute[72803]:     <system>
Aug 15 07:03:46 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:03:46 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:03:46 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:03:46 user nova-compute[72803]:       <entry name="serial">59123d08-1213-4b26-865e-8a12efde9744</entry>
Aug 15 07:03:46 user nova-compute[72803]:       <entry name="uuid">59123d08-1213-4b26-865e-8a12efde9744</entry>
Aug 15 07:03:46 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:03:46 user nova-compute[72803]:     </system>
Aug 15 07:03:46 user nova-compute[72803]:   </sysinfo>
Aug 15 07:03:46 user nova-compute[72803]:   <os>
Aug 15 07:03:46 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:03:46 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:03:46 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:03:46 user nova-compute[72803]:   </os>
Aug 15 07:03:46 user nova-compute[72803]:   <features>
Aug 15 07:03:46 user nova-compute[72803]:     <acpi/>
Aug 15 07:03:46 user nova-compute[72803]:     <apic/>
Aug 15 07:03:46 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:03:46 user nova-compute[72803]:   </features>
Aug 15 07:03:46 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:03:46 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:03:46 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:03:46 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:03:46 user nova-compute[72803]:   </clock>
Aug 15 07:03:46 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:03:46 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:03:46 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:03:46 user nova-compute[72803]:   </cpu>
Aug 15 07:03:46 user nova-compute[72803]:   <devices>
Aug 15 07:03:46 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:03:46 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:03:46 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk"/>
Aug 15 07:03:46 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:03:46 user nova-compute[72803]:     </disk>
Aug 15 07:03:46 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:03:46 user nova-compute[72803]:       <mac address="fa:16:3e:02:0f:13"/>
Aug 15 07:03:46 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:46 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:03:46 user nova-compute[72803]:       <target dev="tap0b2c94f6-af"/>
Aug 15 07:03:46 user nova-compute[72803]:     </interface>
Aug 15 07:03:46 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:03:46 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/console.log" append="off"/>
Aug 15 07:03:46 user nova-compute[72803]:     </serial>
Aug 15 07:03:46 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:03:46 user nova-compute[72803]:     <video>
Aug 15 07:03:46 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:46 user nova-compute[72803]:     </video>
Aug 15 07:03:46 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:03:46 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:03:46 user nova-compute[72803]:     </rng>
Aug 15 07:03:46 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:03:46 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:03:46 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:03:46 user nova-compute[72803]:     </memballoon>
Aug 15 07:03:46 user nova-compute[72803]:   </devices>
Aug 15 07:03:46 user nova-compute[72803]: </domain>
Aug 15 07:03:46 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-736575719',display_name='tempest-VolumesSnapshotTestJSON-instance-736575719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-736575719',id=25,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeJLaHK92HXJJFMCSV+D3kKEP3kQBRMGMhoBd3/gDUTJVtNl2V6B6IrjUvsejsBLdT+lziTkqLbCmWcHrSFE0672gpHlCDKxv0w4nAU466C2TpuEdjDMHqobvaYthOfDA==',key_name='tempest-keypair-1189402010',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415992ab9c124f2db890795802e64ed3',ramdisk_id='',reservation_id='r-1qdp1k7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1700542254',owner_user_name='tempest-VolumesSnapshotTestJSON-1700542254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c445be5492b44a4ac0ab0ffb9bf6b61',uuid=59123d08-1213-4b26-865e-8a12efde9744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converting VIF {"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:0f:13,bridge_name='br-int',has_traffic_filtering=True,id=0b2c94f6-afae-4e9d-b856-c8f2c9efe1db,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2c94f6-af') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG os_vif [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0f:13,bridge_name='br-int',has_traffic_filtering=True,id=0b2c94f6-afae-4e9d-b856-c8f2c9efe1db,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2c94f6-af') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b2c94f6-af, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b2c94f6-af, col_values=(('external_ids', {'iface-id': '0b2c94f6-afae-4e9d-b856-c8f2c9efe1db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:0f:13', 'vm-uuid': '59123d08-1213-4b26-865e-8a12efde9744'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:46 user nova-compute[72803]: INFO os_vif [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:0f:13,bridge_name='br-int',has_traffic_filtering=True,id=0b2c94f6-afae-4e9d-b856-c8f2c9efe1db,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2c94f6-af')
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No VIF found with MAC fa:16:3e:02:0f:13, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.network.neutron [req-b4eb7ce3-5802-4423-b365-b1aeac602200 req-d19fa359-9753-41fa-95b9-be8ac1f5b571 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Updated VIF entry in instance network info cache for port 0b2c94f6-afae-4e9d-b856-c8f2c9efe1db. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG nova.network.neutron [req-b4eb7ce3-5802-4423-b365-b1aeac602200 req-d19fa359-9753-41fa-95b9-be8ac1f5b571 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Updating instance_info_cache with network_info: [{"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b4eb7ce3-5802-4423-b365-b1aeac602200 req-d19fa359-9753-41fa-95b9-be8ac1f5b571 service nova] Releasing lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-a56ad5ae-756f-4488-a74d-891329732092 req-932590bc-b192-46e1-8ead-f2e685a5c8d5 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a56ad5ae-756f-4488-a74d-891329732092 req-932590bc-b192-46e1-8ead-f2e685a5c8d5 service nova] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a56ad5ae-756f-4488-a74d-891329732092 req-932590bc-b192-46e1-8ead-f2e685a5c8d5 service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a56ad5ae-756f-4488-a74d-891329732092 req-932590bc-b192-46e1-8ead-f2e685a5c8d5 service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-a56ad5ae-756f-4488-a74d-891329732092 req-932590bc-b192-46e1-8ead-f2e685a5c8d5 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] No waiting events found dispatching network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:47 user nova-compute[72803]: WARNING nova.compute.manager [req-a56ad5ae-756f-4488-a74d-891329732092 req-932590bc-b192-46e1-8ead-f2e685a5c8d5 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received unexpected event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db for instance with vm_state building and task_state spawning.
Aug 15 07:03:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083029.6615372, 59123d08-1213-4b26-865e-8a12efde9744 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:49 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] VM Resumed (Lifecycle Event)
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:03:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Instance spawned successfully.
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:03:49 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083029.6626375, 59123d08-1213-4b26-865e-8a12efde9744 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:03:49 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] VM Started (Lifecycle Event)
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:03:49 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:03:49 user nova-compute[72803]: INFO nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-deecc9ca-7842-4f16-a42a-146c607faca6 req-291cf241-0197-4c28-a64f-9a5bce1f2aa9 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-deecc9ca-7842-4f16-a42a-146c607faca6 req-291cf241-0197-4c28-a64f-9a5bce1f2aa9 service nova] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-deecc9ca-7842-4f16-a42a-146c607faca6 req-291cf241-0197-4c28-a64f-9a5bce1f2aa9 service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-deecc9ca-7842-4f16-a42a-146c607faca6 req-291cf241-0197-4c28-a64f-9a5bce1f2aa9 service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-deecc9ca-7842-4f16-a42a-146c607faca6 req-291cf241-0197-4c28-a64f-9a5bce1f2aa9 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] No waiting events found dispatching network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:03:49 user nova-compute[72803]: WARNING nova.compute.manager [req-deecc9ca-7842-4f16-a42a-146c607faca6 req-291cf241-0197-4c28-a64f-9a5bce1f2aa9 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received unexpected event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db for instance with vm_state building and task_state spawning.
Aug 15 07:03:49 user nova-compute[72803]: INFO nova.compute.manager [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Took 10.66 seconds to build instance.
Aug 15 07:03:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7a99de2-2708-4d87-aadf-376527fddacc tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.802s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:03:56 user nova-compute[72803]: INFO nova.compute.claims [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Claim successful on node user
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.network.neutron [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:03:56 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.policy [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc7ee5090ba54d4b8acbd4c9f84835f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ede5bd5cb24059bc4a185badef865d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:03:56 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Creating image(s)
Aug 15 07:03:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "/opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "/opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk 1073741824" returned: 0 in 0.062s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Successfully created port: ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.255s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Cannot resize image /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG nova.objects.instance [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'migration_context' on Instance uuid c2c458fd-fdc5-43df-a7c2-f53463a33119 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Ensure instance console log exists: /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:03:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Successfully updated port: ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquired lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-2a4de89d-11c1-4b8c-b367-e84b2335f6e7 req-7697b00a-6bce-4cad-9771-78e98477e731 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received event network-changed-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-2a4de89d-11c1-4b8c-b367-e84b2335f6e7 req-7697b00a-6bce-4cad-9771-78e98477e731 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Refreshing instance network info cache due to event network-changed-ea738c65-7aa6-4796-971f-7047ee6c6a37. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a4de89d-11c1-4b8c-b367-e84b2335f6e7 req-7697b00a-6bce-4cad-9771-78e98477e731 service nova] Acquiring lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Updating instance_info_cache with network_info: [{"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Releasing lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Instance network_info: |[{"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a4de89d-11c1-4b8c-b367-e84b2335f6e7 req-7697b00a-6bce-4cad-9771-78e98477e731 service nova] Acquired lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a4de89d-11c1-4b8c-b367-e84b2335f6e7 req-7697b00a-6bce-4cad-9771-78e98477e731 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Refreshing network info cache for port ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:03:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Start _get_guest_xml network_info=[{"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:03:59 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:59 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1418865815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1418865815',id=26,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-booj14nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:57Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=c2c458fd-fdc5-43df-a7c2-f53463a33119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:4f,bridge_name='br-int',has_traffic_filtering=True,id=ea738c65-7aa6-4796-971f-7047ee6c6a37,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea738c65-7a') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.objects.instance [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'pci_devices' on Instance uuid c2c458fd-fdc5-43df-a7c2-f53463a33119 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:03:59 user nova-compute[72803]:   <uuid>c2c458fd-fdc5-43df-a7c2-f53463a33119</uuid>
Aug 15 07:03:59 user nova-compute[72803]:   <name>instance-0000001a</name>
Aug 15 07:03:59 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:03:59 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:03:59 user nova-compute[72803]:   <metadata>
Aug 15 07:03:59 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:03:59 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:03:59 user nova-compute[72803]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1418865815</nova:name>
Aug 15 07:03:59 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:03:59</nova:creationTime>
Aug 15 07:03:59 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:03:59 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:03:59 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:03:59 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:03:59 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:03:59 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:03:59 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:03:59 user nova-compute[72803]:       <nova:owner>
Aug 15 07:03:59 user nova-compute[72803]:         <nova:user uuid="bc7ee5090ba54d4b8acbd4c9f84835f3">tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member</nova:user>
Aug 15 07:03:59 user nova-compute[72803]:         <nova:project uuid="07ede5bd5cb24059bc4a185badef865d">tempest-ServerBootFromVolumeStableRescueTest-1860507335</nova:project>
Aug 15 07:03:59 user nova-compute[72803]:       </nova:owner>
Aug 15 07:03:59 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:03:59 user nova-compute[72803]:       <nova:ports>
Aug 15 07:03:59 user nova-compute[72803]:         <nova:port uuid="ea738c65-7aa6-4796-971f-7047ee6c6a37">
Aug 15 07:03:59 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 07:03:59 user nova-compute[72803]:         </nova:port>
Aug 15 07:03:59 user nova-compute[72803]:       </nova:ports>
Aug 15 07:03:59 user nova-compute[72803]:     </nova:instance>
Aug 15 07:03:59 user nova-compute[72803]:   </metadata>
Aug 15 07:03:59 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:03:59 user nova-compute[72803]:     <system>
Aug 15 07:03:59 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:03:59 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:03:59 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:03:59 user nova-compute[72803]:       <entry name="serial">c2c458fd-fdc5-43df-a7c2-f53463a33119</entry>
Aug 15 07:03:59 user nova-compute[72803]:       <entry name="uuid">c2c458fd-fdc5-43df-a7c2-f53463a33119</entry>
Aug 15 07:03:59 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:03:59 user nova-compute[72803]:     </system>
Aug 15 07:03:59 user nova-compute[72803]:   </sysinfo>
Aug 15 07:03:59 user nova-compute[72803]:   <os>
Aug 15 07:03:59 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:03:59 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:03:59 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:03:59 user nova-compute[72803]:   </os>
Aug 15 07:03:59 user nova-compute[72803]:   <features>
Aug 15 07:03:59 user nova-compute[72803]:     <acpi/>
Aug 15 07:03:59 user nova-compute[72803]:     <apic/>
Aug 15 07:03:59 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:03:59 user nova-compute[72803]:   </features>
Aug 15 07:03:59 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:03:59 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:03:59 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:03:59 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:03:59 user nova-compute[72803]:   </clock>
Aug 15 07:03:59 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:03:59 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:03:59 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:03:59 user nova-compute[72803]:   </cpu>
Aug 15 07:03:59 user nova-compute[72803]:   <devices>
Aug 15 07:03:59 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:03:59 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:03:59 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk"/>
Aug 15 07:03:59 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:03:59 user nova-compute[72803]:     </disk>
Aug 15 07:03:59 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:03:59 user nova-compute[72803]:       <mac address="fa:16:3e:c9:fc:4f"/>
Aug 15 07:03:59 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:59 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:03:59 user nova-compute[72803]:       <target dev="tapea738c65-7a"/>
Aug 15 07:03:59 user nova-compute[72803]:     </interface>
Aug 15 07:03:59 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:03:59 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/console.log" append="off"/>
Aug 15 07:03:59 user nova-compute[72803]:     </serial>
Aug 15 07:03:59 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:03:59 user nova-compute[72803]:     <video>
Aug 15 07:03:59 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:03:59 user nova-compute[72803]:     </video>
Aug 15 07:03:59 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:03:59 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:03:59 user nova-compute[72803]:     </rng>
Aug 15 07:03:59 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:03:59 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:03:59 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:03:59 user nova-compute[72803]:     </memballoon>
Aug 15 07:03:59 user nova-compute[72803]:   </devices>
Aug 15 07:03:59 user nova-compute[72803]: </domain>
Aug 15 07:03:59 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1418865815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1418865815',id=26,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-booj14nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:03:57Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=c2c458fd-fdc5-43df-a7c2-f53463a33119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:4f,bridge_name='br-int',has_traffic_filtering=True,id=ea738c65-7aa6-4796-971f-7047ee6c6a37,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea738c65-7a') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG os_vif [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:4f,bridge_name='br-int',has_traffic_filtering=True,id=ea738c65-7aa6-4796-971f-7047ee6c6a37,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea738c65-7a') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea738c65-7a, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea738c65-7a, col_values=(('external_ids', {'iface-id': 'ea738c65-7aa6-4796-971f-7047ee6c6a37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:fc:4f', 'vm-uuid': 'c2c458fd-fdc5-43df-a7c2-f53463a33119'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:03:59 user nova-compute[72803]: INFO os_vif [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:fc:4f,bridge_name='br-int',has_traffic_filtering=True,id=ea738c65-7aa6-4796-971f-7047ee6c6a37,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea738c65-7a')
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No VIF found with MAC fa:16:3e:c9:fc:4f, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a4de89d-11c1-4b8c-b367-e84b2335f6e7 req-7697b00a-6bce-4cad-9771-78e98477e731 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Updated VIF entry in instance network info cache for port ea738c65-7aa6-4796-971f-7047ee6c6a37. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a4de89d-11c1-4b8c-b367-e84b2335f6e7 req-7697b00a-6bce-4cad-9771-78e98477e731 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Updating instance_info_cache with network_info: [{"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:03:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a4de89d-11c1-4b8c-b367-e84b2335f6e7 req-7697b00a-6bce-4cad-9771-78e98477e731 service nova] Releasing lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-fd65ae65-6b0d-4518-94ac-ab7fcd6f39d3 req-2c31467c-83e0-4bd0-9bba-cb8770138c7a service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received event network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fd65ae65-6b0d-4518-94ac-ab7fcd6f39d3 req-2c31467c-83e0-4bd0-9bba-cb8770138c7a service nova] Acquiring lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fd65ae65-6b0d-4518-94ac-ab7fcd6f39d3 req-2c31467c-83e0-4bd0-9bba-cb8770138c7a service nova] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fd65ae65-6b0d-4518-94ac-ab7fcd6f39d3 req-2c31467c-83e0-4bd0-9bba-cb8770138c7a service nova] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-fd65ae65-6b0d-4518-94ac-ab7fcd6f39d3 req-2c31467c-83e0-4bd0-9bba-cb8770138c7a service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] No waiting events found dispatching network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:04:00 user nova-compute[72803]: WARNING nova.compute.manager [req-fd65ae65-6b0d-4518-94ac-ab7fcd6f39d3 req-2c31467c-83e0-4bd0-9bba-cb8770138c7a service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received unexpected event network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 for instance with vm_state building and task_state spawning.
Aug 15 07:04:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083042.7036443, c2c458fd-fdc5-43df-a7c2-f53463a33119 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:04:02 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] VM Resumed (Lifecycle Event)
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:04:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Instance spawned successfully.
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:04:02 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083042.706369, c2c458fd-fdc5-43df-a7c2-f53463a33119 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:04:02 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] VM Started (Lifecycle Event)
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:04:02 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:04:02 user nova-compute[72803]: INFO nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3ebb333c-b514-4709-8a65-26602a9f524b req-a5e924f2-3a1e-4200-9ac2-8cdc838ae889 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received event network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3ebb333c-b514-4709-8a65-26602a9f524b req-a5e924f2-3a1e-4200-9ac2-8cdc838ae889 service nova] Acquiring lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3ebb333c-b514-4709-8a65-26602a9f524b req-a5e924f2-3a1e-4200-9ac2-8cdc838ae889 service nova] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3ebb333c-b514-4709-8a65-26602a9f524b req-a5e924f2-3a1e-4200-9ac2-8cdc838ae889 service nova] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3ebb333c-b514-4709-8a65-26602a9f524b req-a5e924f2-3a1e-4200-9ac2-8cdc838ae889 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] No waiting events found dispatching network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:04:02 user nova-compute[72803]: WARNING nova.compute.manager [req-3ebb333c-b514-4709-8a65-26602a9f524b req-a5e924f2-3a1e-4200-9ac2-8cdc838ae889 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received unexpected event network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 for instance with vm_state building and task_state spawning.
Aug 15 07:04:02 user nova-compute[72803]: INFO nova.compute.manager [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Took 6.84 seconds to build instance.
Aug 15 07:04:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-44504998-60f6-42cf-a11f-0a4c334d8ce3 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.952s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-f95a7837-6a62-44cb-a4cf-90f5279d2552 req-3b641b79-03d7-48c1-881d-7328552d693b service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-f95a7837-6a62-44cb-a4cf-90f5279d2552 req-3b641b79-03d7-48c1-881d-7328552d693b service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing instance network info cache due to event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f95a7837-6a62-44cb-a4cf-90f5279d2552 req-3b641b79-03d7-48c1-881d-7328552d693b service nova] Acquiring lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f95a7837-6a62-44cb-a4cf-90f5279d2552 req-3b641b79-03d7-48c1-881d-7328552d693b service nova] Acquired lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG nova.network.neutron [req-f95a7837-6a62-44cb-a4cf-90f5279d2552 req-3b641b79-03d7-48c1-881d-7328552d693b service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:17 user nova-compute[72803]: INFO nova.compute.manager [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Shelve offloading
Aug 15 07:04:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG nova.network.neutron [req-f95a7837-6a62-44cb-a4cf-90f5279d2552 req-3b641b79-03d7-48c1-881d-7328552d693b service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updated VIF entry in instance network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:04:17 user nova-compute[72803]: DEBUG nova.network.neutron [req-f95a7837-6a62-44cb-a4cf-90f5279d2552 req-3b641b79-03d7-48c1-881d-7328552d693b service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f95a7837-6a62-44cb-a4cf-90f5279d2552 req-3b641b79-03d7-48c1-881d-7328552d693b service nova] Releasing lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4064a58-722c-401d-a578-c92e28445644 req-86f36c5d-bfe8-4799-af8a-ad400be9074b service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-unplugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4064a58-722c-401d-a578-c92e28445644 req-86f36c5d-bfe8-4799-af8a-ad400be9074b service nova] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4064a58-722c-401d-a578-c92e28445644 req-86f36c5d-bfe8-4799-af8a-ad400be9074b service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4064a58-722c-401d-a578-c92e28445644 req-86f36c5d-bfe8-4799-af8a-ad400be9074b service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4064a58-722c-401d-a578-c92e28445644 req-86f36c5d-bfe8-4799-af8a-ad400be9074b service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] No waiting events found dispatching network-vif-unplugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:04:18 user nova-compute[72803]: WARNING nova.compute.manager [req-a4064a58-722c-401d-a578-c92e28445644 req-86f36c5d-bfe8-4799-af8a-ad400be9074b service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received unexpected event network-vif-unplugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d for instance with vm_state active and task_state shelving.
Aug 15 07:04:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-846fde10-155a-44bd-9324-55c92eb2c919 req-32bd4704-13db-44eb-90b0-9d8e04ea3ed4 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received event network-changed-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-846fde10-155a-44bd-9324-55c92eb2c919 req-32bd4704-13db-44eb-90b0-9d8e04ea3ed4 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Refreshing instance network info cache due to event network-changed-7aa521d7-60f7-4b67-836d-1c4e6bd8c131. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-846fde10-155a-44bd-9324-55c92eb2c919 req-32bd4704-13db-44eb-90b0-9d8e04ea3ed4 service nova] Acquiring lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-846fde10-155a-44bd-9324-55c92eb2c919 req-32bd4704-13db-44eb-90b0-9d8e04ea3ed4 service nova] Acquired lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG nova.network.neutron [req-846fde10-155a-44bd-9324-55c92eb2c919 req-32bd4704-13db-44eb-90b0-9d8e04ea3ed4 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Refreshing network info cache for port 7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:04:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance destroyed successfully.
Aug 15 07:04:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquired lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:04:18 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Releasing lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.network.neutron [req-846fde10-155a-44bd-9324-55c92eb2c919 req-32bd4704-13db-44eb-90b0-9d8e04ea3ed4 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Updated VIF entry in instance network info cache for port 7aa521d7-60f7-4b67-836d-1c4e6bd8c131. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.network.neutron [req-846fde10-155a-44bd-9324-55c92eb2c919 req-32bd4704-13db-44eb-90b0-9d8e04ea3ed4 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Updating instance_info_cache with network_info: [{"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-846fde10-155a-44bd-9324-55c92eb2c919 req-32bd4704-13db-44eb-90b0-9d8e04ea3ed4 service nova] Releasing lock "refresh_cache-f5cf8ddf-e3c0-403e-91ff-ca1233b33576" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:19 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance destroyed successfully.
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lazy-loading 'resources' on Instance uuid 506ed7b9-6081-418b-86a8-278db430893e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1082719568',display_name='tempest-TestShelveInstance-server-1082719568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1082719568',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbYx1mHtDaQkRYxVSgFx3/zYCh0BDptX/w5QUs6vm39XSEWJ8BZXfgKtz7t3wTUrOUYvJerQtU9Q87bW4thFUZhERMvyG/uzW6UFIBtCRlr89WUEXAWXxHYx2ImaDYi8g==',key_name='tempest-TestShelveInstance-2020944849',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ba0ba51fa2449daae318ca760c32784',ramdisk_id='',reservation_id='r-pyv4bacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1431210887',owner_user_name='tempest-TestShelveInstance-1431210887-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:02:51Z,user_data=None,user_id='10b9814cfdf2413c9d0ed361ed3aa46d',uuid=506ed7b9-6081-418b-86a8-278db430893e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converting VIF {"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_vif [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e2cc686-e8, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-453e4be5-77d0-466b-b19b-4779c2a343d3 req-c988b6bf-a8eb-4be1-87a5-65ccdbb6f93c service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-453e4be5-77d0-466b-b19b-4779c2a343d3 req-c988b6bf-a8eb-4be1-87a5-65ccdbb6f93c service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing instance network info cache due to event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-453e4be5-77d0-466b-b19b-4779c2a343d3 req-c988b6bf-a8eb-4be1-87a5-65ccdbb6f93c service nova] Acquiring lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-453e4be5-77d0-466b-b19b-4779c2a343d3 req-c988b6bf-a8eb-4be1-87a5-65ccdbb6f93c service nova] Acquired lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.network.neutron [req-453e4be5-77d0-466b-b19b-4779c2a343d3 req-c988b6bf-a8eb-4be1-87a5-65ccdbb6f93c service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:19 user nova-compute[72803]: INFO os_vif [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8')
Aug 15 07:04:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxVByZMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:04:19 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3046c17b-324f-4b76-8e95-d85f8d387269]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a190b1f-891e-40dc-9a70-73c20219438a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:19 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:04:19 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:19 user nova-compute[72803]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:04:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:19 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:04:19 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:19 user nova-compute[72803]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:04:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0627520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f075a0-9ff0-470e-ab0f-8b5c5efb4f7f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3585981-c7ed-4d88-aa1b-0b23fb3dc4c7]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[760d5367-cad0-4078-afb0-ab04f41c811c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a977f3d9-e7c5-4886-a1d4-a74c79f48848]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:04:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8551678c-861f-473c-8a4e-0e06bfc39137]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ecbb11-a35f-404d-8fe2-48d2c8922013]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260]
Aug 15 07:04:20 user nova-compute[72803]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260] successful.
Aug 15 07:04:20 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ef958d-202f-4ea4-8639-4271f9f6a763]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] <== disconnect_volume: return (349ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:04:20 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Deleting instance files /opt/stack/data/nova/instances/506ed7b9-6081-418b-86a8-278db430893e_del
Aug 15 07:04:20 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Deletion of /opt/stack/data/nova/instances/506ed7b9-6081-418b-86a8-278db430893e_del complete
Aug 15 07:04:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-bb2f78fa-4346-4a2e-954a-fa5713e4d59b req-070135a8-db2d-4725-be82-95fd46b15ad6 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bb2f78fa-4346-4a2e-954a-fa5713e4d59b req-070135a8-db2d-4725-be82-95fd46b15ad6 service nova] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bb2f78fa-4346-4a2e-954a-fa5713e4d59b req-070135a8-db2d-4725-be82-95fd46b15ad6 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bb2f78fa-4346-4a2e-954a-fa5713e4d59b req-070135a8-db2d-4725-be82-95fd46b15ad6 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-bb2f78fa-4346-4a2e-954a-fa5713e4d59b req-070135a8-db2d-4725-be82-95fd46b15ad6 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] No waiting events found dispatching network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:04:20 user nova-compute[72803]: WARNING nova.compute.manager [req-bb2f78fa-4346-4a2e-954a-fa5713e4d59b req-070135a8-db2d-4725-be82-95fd46b15ad6 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received unexpected event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d for instance with vm_state active and task_state shelving.
Aug 15 07:04:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-453e4be5-77d0-466b-b19b-4779c2a343d3 req-c988b6bf-a8eb-4be1-87a5-65ccdbb6f93c service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updated VIF entry in instance network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-453e4be5-77d0-466b-b19b-4779c2a343d3 req-c988b6bf-a8eb-4be1-87a5-65ccdbb6f93c service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": null, "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-453e4be5-77d0-466b-b19b-4779c2a343d3 req-c988b6bf-a8eb-4be1-87a5-65ccdbb6f93c service nova] Releasing lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:21 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Deleted allocations for instance 506ed7b9-6081-418b-86a8-278db430893e
Aug 15 07:04:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lazy-loading 'numa_topology' on Instance uuid 506ed7b9-6081-418b-86a8-278db430893e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:21 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:04:21 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:04:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cea5d14f-025a-43c6-9f87-00132ebe81d3 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.854s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid f5cf8ddf-e3c0-403e-91ff-ca1233b33576 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:23 user nova-compute[72803]: INFO nova.compute.manager [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Attaching volume fb716a7f-4374-46bb-be18-6020dfe0f856 to /dev/vdb
Aug 15 07:04:23 user nova-compute[72803]: DEBUG os_brick.utils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f3d7ea-458a-4de1-b2f3-c3ba68b4a2e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0518891d-a748-44b2-a7a7-b9f522a7d128]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c8f5c-3eb8-4811-9c7b-c66a54ec7a2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e34e03-fafa-4438-bb31-c40bbcae7ec7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:04:23 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:04:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a58dfe-34b5-4b33-a86b-2c4483a6ed17]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG os_brick.utils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:04:23 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Updating existing volume attachment record: 680655e7-d25c-4bfd-8055-cf86ae590af4 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:04:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:24 user nova-compute[72803]: INFO nova.compute.manager [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Detaching volume 2a7c447c-91dc-45d2-b672-c916022fedd2
Aug 15 07:04:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:24 user nova-compute[72803]: INFO nova.virt.block_device [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Attempting to driver detach volume 2a7c447c-91dc-45d2-b672-c916022fedd2 from mountpoint /dev/vdb
Aug 15 07:04:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Attempting to detach device vdb from instance 06a22c66-fe35-4c52-aef9-9801f38d2832 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:04:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:04:24 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:04:24 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:04:24 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:04:24 user nova-compute[72803]:   <serial>2a7c447c-91dc-45d2-b672-c916022fedd2</serial>
Aug 15 07:04:24 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 07:04:24 user nova-compute[72803]: </disk>
Aug 15 07:04:24 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:04:24 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully detached device vdb from instance 06a22c66-fe35-4c52-aef9-9801f38d2832 from the persistent domain config.
Aug 15 07:04:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06a22c66-fe35-4c52-aef9-9801f38d2832 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:04:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:04:24 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:04:24 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:04:24 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:04:24 user nova-compute[72803]:   <serial>2a7c447c-91dc-45d2-b672-c916022fedd2</serial>
Aug 15 07:04:24 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 07:04:24 user nova-compute[72803]: </disk>
Aug 15 07:04:24 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083065.2745798, 06a22c66-fe35-4c52-aef9-9801f38d2832 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:04:25 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully detached device vdb from instance 06a22c66-fe35-4c52-aef9-9801f38d2832 from the live domain config.
Aug 15 07:04:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYxvRlow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:04:25 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0db4b0-997c-4730-8bc8-3417c513e1b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9141166-0be3-4e43-b799-37cd753fac74]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:25 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:04:25 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:25 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:25 user nova-compute[72803]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 (non-flash)
Aug 15 07:04:25 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:25 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0626320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b042d774-a1e1-49f3-85b8-f5a6d603f334]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dea0427-d89f-4783-9083-c9144975b23c]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2e4e4-0f96-48e5-a950-f5e148188435]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f1a2ef-94e8-444f-9e1c-4a4b90fa737c]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd96d1a-6476-41be-899d-803fbdb5f8f9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac68ac6-ba67-455d-89ec-1364dde58f3e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260]
Aug 15 07:04:25 user nova-compute[72803]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2, portal: 172.16.0.220,3260] successful.
Aug 15 07:04:25 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a7c447c-91dc-45d2-b672-c916022fedd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4492fe40-2bdd-4a06-831a-2562c61266df]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== disconnect_volume: return (279ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:04:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:04:26 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'flavor' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7d98e57f-4733-44db-b8fc-5f4a569c8989 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.693s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFSAxzqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:04:32 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:04:32 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:04:32 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a9a712-9523-47b2-8693-2711104f7a2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:04:32 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f2ffc-5202-412c-9b39-d8d495d693bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856] added
Aug 15 07:04:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a91c7ec-a759-4740-9276-9ea13c802b04]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb447118-25d9-46a1-af4e-d42c59eedb23]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFSAxzqH {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFSAxzqH" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15f0411-c7ac-4064-9bf9-3edb50ad18dc]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tFSAxzqH'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3754d82c-cd90-48c1-92ae-b4639c0d5d0d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee0f719-22d4-44f8-84a9-b400ebf1b1ab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feca921-be85-415a-ba5e-f037009b3095]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856, portal: 172.16.0.220,3260]
Aug 15 07:04:32 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856, portal: 172.16.0.220,3260] successful.
Aug 15 07:04:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9360cc4c-0c56-4cba-9b12-f563d93fa625]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128e25f-8b3b-4b76-862d-e1b575b6e3a7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquired lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG nova.network.neutron [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'info_cache' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[07733726-a26c-4d29-90a2-de6629b83df1]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.network.neutron [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Releasing lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:33 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance destroyed successfully.
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'resources' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_vif [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7026c22f-40, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:04:33 user nova-compute[72803]: INFO os_vif [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40')
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJTviluY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:04:33 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083058.5812206, 506ed7b9-6081-418b-86a8-278db430893e => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:04:33 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] VM Stopped (Lifecycle Event)
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8cb84d1c-dcc1-4b65-8d8a-6395b5e5b37c None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFSAxzqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26161323433333163', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161323433333163', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.333s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid f5cf8ddf-e3c0-403e-91ff-ca1233b33576 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3108f34d-12e6-423b-97ce-c85b34a0fb97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:04:33 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:04:33 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:04:33 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:04:33 user nova-compute[72803]:   <serial>fb716a7f-4374-46bb-be18-6020dfe0f856</serial>
Aug 15 07:04:33 user nova-compute[72803]: </disk>
Aug 15 07:04:33 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dce9ae-13e7-4106-ac99-ad2fc925af5d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:33 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:33 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:33 user nova-compute[72803]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:33 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05a9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f75a9f-d8de-4084-9321-28b9a69a33fa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[58502339-6576-4803-94f3-82bb73fd1e76]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd290387-8dc8-4d44-a457-088f553c42e4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[184bbf2b-aa45-4754-b7df-58d70df77ede]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2825545-b19b-4386-81b3-de2e0d086102]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffbf145-0575-477d-a3ba-4340859bf5e8]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260]
Aug 15 07:04:33 user nova-compute[72803]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260] successful.
Aug 15 07:04:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[446e074c-e944-4900-a4cf-c34cb7fb9786]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== disconnect_volume: return (621ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Start _get_guest_xml network_info=[{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '264dc839-50e4-4ebb-ac80-feef330fd9fa', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJTviluY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '5170f08d-a847-4094-82b7-749797acf8b7', 'attached_at': '', 'detached_at': '', 'volume_id': '909730d3-22b7-4511-8621-39bafd2e5359', 'serial': '909730d3-22b7-4511-8621-39bafd2e5359'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'numa_topology' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:33 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:04:33 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:04:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJTviluY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:04:34 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:04:34 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:04:34 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fde8e8e-88bc-407c-98e7-0e986d9b94c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:04:34 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3876024-9e12-48c5-b9ec-34ad3dca3253]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359] added
Aug 15 07:04:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd43e5d-fa82-4441-8a57-7ca2bb256767]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2ba5e-6920-4f12-b205-67a9177e8907]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJTviluY {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No VIF found with MAC fa:16:3e:f1:f6:51, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJTviluY" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c33661-1d5d-422f-8e22-e45fbbc5224d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJTviluY'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[785157ab-61ca-4d1e-a3d7-f30ff010e405]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b74454-e404-40ae-8431-dd93274d4578]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb32a1a-a144-4a9a-b0a7-92173aca45ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260]
Aug 15 07:04:34 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260] successful.
Aug 15 07:04:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[59289402-78ce-452d-9ebc-826482359347]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dec78daa-fa11-40d0-9a02-f087bae39e96 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.069s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[474401ee-24ba-4f40-80b3-12be9bd9d060]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8fc60b-4709-4b01-9295-f7bf9eaaf011]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJTviluY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:04:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26230343363363234', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230343363363234', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'pci_devices' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:35 user nova-compute[72803]: INFO nova.compute.manager [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Detaching volume fb716a7f-4374-46bb-be18-6020dfe0f856
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:04:35 user nova-compute[72803]:   <uuid>5170f08d-a847-4094-82b7-749797acf8b7</uuid>
Aug 15 07:04:35 user nova-compute[72803]:   <name>instance-00000012</name>
Aug 15 07:04:35 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:04:35 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:04:35 user nova-compute[72803]:   <metadata>
Aug 15 07:04:35 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:04:35 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:04:35 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeTestJSON-server-1872031898</nova:name>
Aug 15 07:04:35 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:04:33</nova:creationTime>
Aug 15 07:04:35 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:04:35 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:04:35 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:04:35 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:04:35 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:04:35 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:04:35 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:04:35 user nova-compute[72803]:       <nova:owner>
Aug 15 07:04:35 user nova-compute[72803]:         <nova:user uuid="aeef867bec97404e9bd1f9810b93ba29">tempest-AttachVolumeTestJSON-820469847-project-member</nova:user>
Aug 15 07:04:35 user nova-compute[72803]:         <nova:project uuid="faa20f14f0f14b6791cce17d3fec420d">tempest-AttachVolumeTestJSON-820469847</nova:project>
Aug 15 07:04:35 user nova-compute[72803]:       </nova:owner>
Aug 15 07:04:35 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:04:35 user nova-compute[72803]:       <nova:ports>
Aug 15 07:04:35 user nova-compute[72803]:         <nova:port uuid="7026c22f-40fe-4665-9fb8-5d116dfe7513">
Aug 15 07:04:35 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 07:04:35 user nova-compute[72803]:         </nova:port>
Aug 15 07:04:35 user nova-compute[72803]:       </nova:ports>
Aug 15 07:04:35 user nova-compute[72803]:     </nova:instance>
Aug 15 07:04:35 user nova-compute[72803]:   </metadata>
Aug 15 07:04:35 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:04:35 user nova-compute[72803]:     <system>
Aug 15 07:04:35 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:04:35 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:04:35 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:04:35 user nova-compute[72803]:       <entry name="serial">5170f08d-a847-4094-82b7-749797acf8b7</entry>
Aug 15 07:04:35 user nova-compute[72803]:       <entry name="uuid">5170f08d-a847-4094-82b7-749797acf8b7</entry>
Aug 15 07:04:35 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:04:35 user nova-compute[72803]:     </system>
Aug 15 07:04:35 user nova-compute[72803]:   </sysinfo>
Aug 15 07:04:35 user nova-compute[72803]:   <os>
Aug 15 07:04:35 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:04:35 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:04:35 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:04:35 user nova-compute[72803]:   </os>
Aug 15 07:04:35 user nova-compute[72803]:   <features>
Aug 15 07:04:35 user nova-compute[72803]:     <acpi/>
Aug 15 07:04:35 user nova-compute[72803]:     <apic/>
Aug 15 07:04:35 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:04:35 user nova-compute[72803]:   </features>
Aug 15 07:04:35 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:04:35 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:04:35 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:04:35 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:04:35 user nova-compute[72803]:   </clock>
Aug 15 07:04:35 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:04:35 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:04:35 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:04:35 user nova-compute[72803]:   </cpu>
Aug 15 07:04:35 user nova-compute[72803]:   <devices>
Aug 15 07:04:35 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:04:35 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:04:35 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk"/>
Aug 15 07:04:35 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:04:35 user nova-compute[72803]:     </disk>
Aug 15 07:04:35 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:04:35 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:04:35 user nova-compute[72803]:       <source dev="/dev/sdc"/>
Aug 15 07:04:35 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:04:35 user nova-compute[72803]:       <serial>909730d3-22b7-4511-8621-39bafd2e5359</serial>
Aug 15 07:04:35 user nova-compute[72803]:     </disk>
Aug 15 07:04:35 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:04:35 user nova-compute[72803]:       <mac address="fa:16:3e:b8:f9:8b"/>
Aug 15 07:04:35 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:04:35 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:04:35 user nova-compute[72803]:       <target dev="tap7026c22f-40"/>
Aug 15 07:04:35 user nova-compute[72803]:     </interface>
Aug 15 07:04:35 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:04:35 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/console.log" append="off"/>
Aug 15 07:04:35 user nova-compute[72803]:     </serial>
Aug 15 07:04:35 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:04:35 user nova-compute[72803]:     <video>
Aug 15 07:04:35 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:04:35 user nova-compute[72803]:     </video>
Aug 15 07:04:35 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:04:35 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:04:35 user nova-compute[72803]:     </rng>
Aug 15 07:04:35 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:04:35 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:04:35 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:04:35 user nova-compute[72803]:     </memballoon>
Aug 15 07:04:35 user nova-compute[72803]:   </devices>
Aug 15 07:04:35 user nova-compute[72803]: </domain>
Aug 15 07:04:35 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:35 user nova-compute[72803]: INFO nova.virt.block_device [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Attempting to driver detach volume fb716a7f-4374-46bb-be18-6020dfe0f856 from mountpoint /dev/vdb
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Attempting to detach device vdb from instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:04:35 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:04:35 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:04:35 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:04:35 user nova-compute[72803]:   <serial>fb716a7f-4374-46bb-be18-6020dfe0f856</serial>
Aug 15 07:04:35 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:04:35 user nova-compute[72803]: </disk>
Aug 15 07:04:35 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:04:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully detached device vdb from instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 from the persistent domain config.
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:04:35 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:04:35 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:04:35 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:04:35 user nova-compute[72803]:   <serial>fb716a7f-4374-46bb-be18-6020dfe0f856</serial>
Aug 15 07:04:35 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:04:35 user nova-compute[72803]: </disk>
Aug 15 07:04:35 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:35 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083076.0643032, f5cf8ddf-e3c0-403e-91ff-ca1233b33576 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:04:36 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully detached device vdb from instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 from the live domain config.
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFSAxzqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:04:36 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd457cb1-0ea1-428c-aaf1-cd2f0eb7b3fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65798e07-aefe-47de-b935-d7352eb23ac8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:36 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:36 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:36 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:04:36 user nova-compute[72803]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 (non-flash)
Aug 15 07:04:36 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:04:36 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f350f3ca4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef3bc0-2a67-44bb-926d-1beb1bbd7e83]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a4e9a4-d331-4662-9698-c6abbdcc4b21]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aab1350-9c32-4b5e-95fe-ce22daee9196]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Cannot resize image /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'migration_context' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_vif [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7026c22f-40, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7026c22f-40, col_values=(('external_ids', {'iface-id': '7026c22f-40fe-4665-9fb8-5d116dfe7513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:f9:8b', 'vm-uuid': '5170f08d-a847-4094-82b7-749797acf8b7'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b523b72-c97b-4c4a-8f0e-4b11bc441e30]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:36 user nova-compute[72803]: INFO os_vif [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40')
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd2bca5-3afb-425c-8273-01b4f51c690e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f3999-cccc-4858-9a54-ba7a9b218643]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856, portal: 172.16.0.220,3260]
Aug 15 07:04:36 user nova-compute[72803]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856, portal: 172.16.0.220,3260] successful.
Aug 15 07:04:36 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb716a7f-4374-46bb-be18-6020dfe0f856 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5904ceaf-1f71-4401-8387-dff566e1c379]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== disconnect_volume: return (291ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updating instance_info_cache with network_info: [{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:04:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG nova.objects.instance [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid f5cf8ddf-e3c0-403e-91ff-ca1233b33576 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-652b7e28-0149-4740-b030-46a99b15d1d0 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.847s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-65933178-3583-4ac7-bc1b-f26e857893f3 req-9fc5a6d7-3231-4c04-912c-f986089c81af service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65933178-3583-4ac7-bc1b-f26e857893f3 req-9fc5a6d7-3231-4c04-912c-f986089c81af service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65933178-3583-4ac7-bc1b-f26e857893f3 req-9fc5a6d7-3231-4c04-912c-f986089c81af service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65933178-3583-4ac7-bc1b-f26e857893f3 req-9fc5a6d7-3231-4c04-912c-f986089c81af service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-65933178-3583-4ac7-bc1b-f26e857893f3 req-9fc5a6d7-3231-4c04-912c-f986089c81af service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:04:37 user nova-compute[72803]: WARNING nova.compute.manager [req-65933178-3583-4ac7-bc1b-f26e857893f3 req-9fc5a6d7-3231-4c04-912c-f986089c81af service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state stopped and task_state powering-on.
Aug 15 07:04:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083079.8396893, 5170f08d-a847-4094-82b7-749797acf8b7 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:04:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Resumed (Lifecycle Event)
Aug 15 07:04:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:04:39 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance rebooted successfully.
Aug 15 07:04:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a6b0bfe9-7439-4238-a777-6dee91fdba97 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:04:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 07:04:39 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083079.8502157, 5170f08d-a847-4094-82b7-749797acf8b7 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:04:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Started (Lifecycle Event)
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:04:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-c72c625b-f13a-4ed1-acb5-cc76438344dc req-d796d71b-0a02-4c48-b024-ad735dd989cb service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c72c625b-f13a-4ed1-acb5-cc76438344dc req-d796d71b-0a02-4c48-b024-ad735dd989cb service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c72c625b-f13a-4ed1-acb5-cc76438344dc req-d796d71b-0a02-4c48-b024-ad735dd989cb service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c72c625b-f13a-4ed1-acb5-cc76438344dc req-d796d71b-0a02-4c48-b024-ad735dd989cb service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-c72c625b-f13a-4ed1-acb5-cc76438344dc req-d796d71b-0a02-4c48-b024-ad735dd989cb service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:04:40 user nova-compute[72803]: WARNING nova.compute.manager [req-c72c625b-f13a-4ed1-acb5-cc76438344dc req-d796d71b-0a02-4c48-b024-ad735dd989cb service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state active and task_state None.
Aug 15 07:04:40 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:04:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:04:43 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:04:43 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:04:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7071MB free_disk=25.373729705810547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:04:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 06a22c66-fe35-4c52-aef9-9801f38d2832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 52b19720-9992-4994-ab65-aae046dcfc54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance bd737048-02f4-4dc3-b386-202d96fd5425 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 59123d08-1213-4b26-865e-8a12efde9744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:04:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb7cb71e-b3fc-4dc1-99fe-944153a1011f req-7aafb893-3296-4170-b66d-0590f3ab31f5 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-changed-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb7cb71e-b3fc-4dc1-99fe-944153a1011f req-7aafb893-3296-4170-b66d-0590f3ab31f5 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Refreshing instance network info cache due to event network-changed-89d1c280-dac6-41fa-8fb1-0d1b31c21f10. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:04:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb7cb71e-b3fc-4dc1-99fe-944153a1011f req-7aafb893-3296-4170-b66d-0590f3ab31f5 service nova] Acquiring lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:04:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb7cb71e-b3fc-4dc1-99fe-944153a1011f req-7aafb893-3296-4170-b66d-0590f3ab31f5 service nova] Acquired lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:04:49 user nova-compute[72803]: DEBUG nova.network.neutron [req-cb7cb71e-b3fc-4dc1-99fe-944153a1011f req-7aafb893-3296-4170-b66d-0590f3ab31f5 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Refreshing network info cache for port 89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:04:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-cb7cb71e-b3fc-4dc1-99fe-944153a1011f req-7aafb893-3296-4170-b66d-0590f3ab31f5 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updated VIF entry in instance network info cache for port 89d1c280-dac6-41fa-8fb1-0d1b31c21f10. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:04:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-cb7cb71e-b3fc-4dc1-99fe-944153a1011f req-7aafb893-3296-4170-b66d-0590f3ab31f5 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb7cb71e-b3fc-4dc1-99fe-944153a1011f req-7aafb893-3296-4170-b66d-0590f3ab31f5 service nova] Releasing lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "52b19720-9992-4994-ab65-aae046dcfc54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "52b19720-9992-4994-ab65-aae046dcfc54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "52b19720-9992-4994-ab65-aae046dcfc54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:54 user nova-compute[72803]: INFO nova.compute.manager [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Terminating instance
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-063e8a81-f04e-4202-95f1-d3d1d1169062 req-5f0826cf-1509-4320-85d8-ffa52a398627 service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received event network-vif-unplugged-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-063e8a81-f04e-4202-95f1-d3d1d1169062 req-5f0826cf-1509-4320-85d8-ffa52a398627 service nova] Acquiring lock "52b19720-9992-4994-ab65-aae046dcfc54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-063e8a81-f04e-4202-95f1-d3d1d1169062 req-5f0826cf-1509-4320-85d8-ffa52a398627 service nova] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-063e8a81-f04e-4202-95f1-d3d1d1169062 req-5f0826cf-1509-4320-85d8-ffa52a398627 service nova] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-063e8a81-f04e-4202-95f1-d3d1d1169062 req-5f0826cf-1509-4320-85d8-ffa52a398627 service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] No waiting events found dispatching network-vif-unplugged-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-063e8a81-f04e-4202-95f1-d3d1d1169062 req-5f0826cf-1509-4320-85d8-ffa52a398627 service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received event network-vif-unplugged-fa4426ff-007f-478a-a489-d61778f916a7 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Instance destroyed successfully.
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.objects.instance [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lazy-loading 'resources' on Instance uuid 52b19720-9992-4994-ab65-aae046dcfc54 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-336339215',display_name='tempest-VolumesNegativeTest-instance-336339215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-336339215',id=22,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05b597754cfb485e932dd63026e40104',ramdisk_id='',reservation_id='r-kjft9xxa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2017874458',owner_user_name='tempest-VolumesNegativeTest-2017874458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:03:15Z,user_data=None,user_id='50aff8fa1c354f4ea9a049f7d7671766',uuid=52b19720-9992-4994-ab65-aae046dcfc54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Converting VIF {"id": "fa4426ff-007f-478a-a489-d61778f916a7", "address": "fa:16:3e:52:c4:07", "network": {"id": "3049574f-5d5d-4d03-aa10-9377cc7e6b5f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5c511622b69f44c9977c15fb910de171", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4426ff-00", "ovs_interfaceid": "fa4426ff-007f-478a-a489-d61778f916a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fa4426ff-007f-478a-a489-d61778f916a7,network=Network(3049574f-5d5d-4d03-aa10-9377cc7e6b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4426ff-00') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG os_vif [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fa4426ff-007f-478a-a489-d61778f916a7,network=Network(3049574f-5d5d-4d03-aa10-9377cc7e6b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4426ff-00') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa4426ff-00, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:54 user nova-compute[72803]: INFO os_vif [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:07,bridge_name='br-int',has_traffic_filtering=True,id=fa4426ff-007f-478a-a489-d61778f916a7,network=Network(3049574f-5d5d-4d03-aa10-9377cc7e6b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4426ff-00')
Aug 15 07:04:54 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Deleting instance files /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54_del
Aug 15 07:04:54 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Deletion of /opt/stack/data/nova/instances/52b19720-9992-4994-ab65-aae046dcfc54_del complete
Aug 15 07:04:54 user nova-compute[72803]: INFO nova.compute.manager [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 15 07:04:54 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:04:54 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:04:55 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:55 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Took 0.70 seconds to deallocate network for instance.
Aug 15 07:04:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-d12547ba-b49f-42b1-aa36-7bf567b81f9d req-2c46ce2a-d4a9-4c4e-aa38-2cbbe93926ed service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received event network-vif-deleted-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:55 user nova-compute[72803]: INFO nova.compute.manager [req-d12547ba-b49f-42b1-aa36-7bf567b81f9d req-2c46ce2a-d4a9-4c4e-aa38-2cbbe93926ed service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Neutron deleted interface fa4426ff-007f-478a-a489-d61778f916a7; detaching it from the instance and deleting it from the info cache
Aug 15 07:04:55 user nova-compute[72803]: DEBUG nova.network.neutron [req-d12547ba-b49f-42b1-aa36-7bf567b81f9d req-2c46ce2a-d4a9-4c4e-aa38-2cbbe93926ed service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-d12547ba-b49f-42b1-aa36-7bf567b81f9d req-2c46ce2a-d4a9-4c4e-aa38-2cbbe93926ed service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Detach interface failed, port_id=fa4426ff-007f-478a-a489-d61778f916a7, reason: Instance 52b19720-9992-4994-ab65-aae046dcfc54 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:04:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:55 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:04:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:04:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:55 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Deleted allocations for instance 52b19720-9992-4994-ab65-aae046dcfc54
Aug 15 07:04:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fc7b59ce-30b0-452d-9016-9134738a57c5 tempest-VolumesNegativeTest-2017874458 tempest-VolumesNegativeTest-2017874458-project-member] Lock "52b19720-9992-4994-ab65-aae046dcfc54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.975s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-179dda68-231c-4a87-b0c7-f1d0744202b1 req-f2a77044-0127-456d-b40a-33caed54b38c service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received event network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-179dda68-231c-4a87-b0c7-f1d0744202b1 req-f2a77044-0127-456d-b40a-33caed54b38c service nova] Acquiring lock "52b19720-9992-4994-ab65-aae046dcfc54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-179dda68-231c-4a87-b0c7-f1d0744202b1 req-f2a77044-0127-456d-b40a-33caed54b38c service nova] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-179dda68-231c-4a87-b0c7-f1d0744202b1 req-f2a77044-0127-456d-b40a-33caed54b38c service nova] Lock "52b19720-9992-4994-ab65-aae046dcfc54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:04:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-179dda68-231c-4a87-b0c7-f1d0744202b1 req-f2a77044-0127-456d-b40a-33caed54b38c service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] No waiting events found dispatching network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:04:56 user nova-compute[72803]: WARNING nova.compute.manager [req-179dda68-231c-4a87-b0c7-f1d0744202b1 req-f2a77044-0127-456d-b40a-33caed54b38c service nova] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Received unexpected event network-vif-plugged-fa4426ff-007f-478a-a489-d61778f916a7 for instance with vm_state deleted and task_state None.
Aug 15 07:04:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-b3e718fb-25db-4774-95c3-f62e55134f23 req-16cb0c43-96b3-43b5-ba13-2da572781e15 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-changed-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:04:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-b3e718fb-25db-4774-95c3-f62e55134f23 req-16cb0c43-96b3-43b5-ba13-2da572781e15 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Refreshing instance network info cache due to event network-changed-390036c0-19a4-46bf-9e26-a90cdb1e2333. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:04:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b3e718fb-25db-4774-95c3-f62e55134f23 req-16cb0c43-96b3-43b5-ba13-2da572781e15 service nova] Acquiring lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:04:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b3e718fb-25db-4774-95c3-f62e55134f23 req-16cb0c43-96b3-43b5-ba13-2da572781e15 service nova] Acquired lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:04:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-b3e718fb-25db-4774-95c3-f62e55134f23 req-16cb0c43-96b3-43b5-ba13-2da572781e15 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Refreshing network info cache for port 390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-b3e718fb-25db-4774-95c3-f62e55134f23 req-16cb0c43-96b3-43b5-ba13-2da572781e15 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updated VIF entry in instance network info cache for port 390036c0-19a4-46bf-9e26-a90cdb1e2333. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-b3e718fb-25db-4774-95c3-f62e55134f23 req-16cb0c43-96b3-43b5-ba13-2da572781e15 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updating instance_info_cache with network_info: [{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b3e718fb-25db-4774-95c3-f62e55134f23 req-16cb0c43-96b3-43b5-ba13-2da572781e15 service nova] Releasing lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:04:59 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:04:59 user nova-compute[72803]: INFO nova.compute.claims [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Claim successful on node user
Aug 15 07:04:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:05:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.policy [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19a7b75860c2469b8d1f126f689a5a48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8d277cf96f40bb97e19deccb16bc4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:05:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Creating image(s)
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "/opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "/opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk 1073741824" returned: 0 in 0.057s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Successfully created port: e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Cannot resize image /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'migration_context' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Ensure instance console log exists: /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:01 user nova-compute[72803]: INFO nova.compute.manager [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Shelving
Aug 15 07:05:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3b4693c2-d999-47d5-8cfb-3d92d3f4cd43 req-fa4b7a45-900a-46cc-b320-ea6164bef39a service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-unplugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b4693c2-d999-47d5-8cfb-3d92d3f4cd43 req-fa4b7a45-900a-46cc-b320-ea6164bef39a service nova] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b4693c2-d999-47d5-8cfb-3d92d3f4cd43 req-fa4b7a45-900a-46cc-b320-ea6164bef39a service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b4693c2-d999-47d5-8cfb-3d92d3f4cd43 req-fa4b7a45-900a-46cc-b320-ea6164bef39a service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3b4693c2-d999-47d5-8cfb-3d92d3f4cd43 req-fa4b7a45-900a-46cc-b320-ea6164bef39a service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] No waiting events found dispatching network-vif-unplugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:02 user nova-compute[72803]: WARNING nova.compute.manager [req-3b4693c2-d999-47d5-8cfb-3d92d3f4cd43 req-fa4b7a45-900a-46cc-b320-ea6164bef39a service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received unexpected event network-vif-unplugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 for instance with vm_state active and task_state shelving.
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Successfully updated port: e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquired lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-e4848a4f-59e1-41d4-b4f0-d3e0d1dc6480 req-7099c2a8-cf14-4fb2-8e49-8e173fd69661 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received event network-changed-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-e4848a4f-59e1-41d4-b4f0-d3e0d1dc6480 req-7099c2a8-cf14-4fb2-8e49-8e173fd69661 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Refreshing instance network info cache due to event network-changed-e478da74-bdfe-4812-b471-86d1252ee7e9. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e4848a4f-59e1-41d4-b4f0-d3e0d1dc6480 req-7099c2a8-cf14-4fb2-8e49-8e173fd69661 service nova] Acquiring lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:05:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance destroyed successfully.
Aug 15 07:05:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Beginning cold snapshot process
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updating instance_info_cache with network_info: [{"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Releasing lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Instance network_info: |[{"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e4848a4f-59e1-41d4-b4f0-d3e0d1dc6480 req-7099c2a8-cf14-4fb2-8e49-8e173fd69661 service nova] Acquired lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.neutron [req-e4848a4f-59e1-41d4-b4f0-d3e0d1dc6480 req-7099c2a8-cf14-4fb2-8e49-8e173fd69661 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Refreshing network info cache for port e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Start _get_guest_xml network_info=[{"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:05:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:05:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk /opt/stack/data/nova/instances/snapshots/tmpk_xnz1tq/f484aea0be164c11a72b2464a1bffd88 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1831556221',display_name='tempest-TestServerVolumeAttachmentScenario-server-1831556221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1831556221',id=27,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHZvTG+ebaAm8p7Sv9K1kYncN0VWhzEWdmNYADnuKmNj4mH/1v12Xf8h4qViplCiU7ghKeXaLg5Te4WP9GyPfnXHpYZ/3cQ52x8slG7kKhPmHN1dUN5HVMn2z9f2lBzuw==',key_name='tempest-keypair-1021243406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da8d277cf96f40bb97e19deccb16bc4c',ramdisk_id='',reservation_id='r-n830zulp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-847255380',owner_user_name='tempest-TestServerVolumeAttachmentScenario-847255380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a7b75860c2469b8d1f126f689a5a48',uuid=9c7018fa-ebd1-4446-a8ca-f775ee3a570d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Converting VIF {"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:2c:d1,bridge_name='br-int',has_traffic_filtering=True,id=e478da74-bdfe-4812-b471-86d1252ee7e9,network=Network(1750ab6d-f5be-41dc-9e91-f68f80bb239a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape478da74-bd') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:05:02 user nova-compute[72803]:   <uuid>9c7018fa-ebd1-4446-a8ca-f775ee3a570d</uuid>
Aug 15 07:05:02 user nova-compute[72803]:   <name>instance-0000001b</name>
Aug 15 07:05:02 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:05:02 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:05:02 user nova-compute[72803]:   <metadata>
Aug 15 07:05:02 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:05:02 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:05:02 user nova-compute[72803]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1831556221</nova:name>
Aug 15 07:05:02 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:05:02</nova:creationTime>
Aug 15 07:05:02 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:05:02 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:05:02 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:05:02 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:05:02 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:05:02 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:05:02 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:05:02 user nova-compute[72803]:       <nova:owner>
Aug 15 07:05:02 user nova-compute[72803]:         <nova:user uuid="19a7b75860c2469b8d1f126f689a5a48">tempest-TestServerVolumeAttachmentScenario-847255380-project-member</nova:user>
Aug 15 07:05:02 user nova-compute[72803]:         <nova:project uuid="da8d277cf96f40bb97e19deccb16bc4c">tempest-TestServerVolumeAttachmentScenario-847255380</nova:project>
Aug 15 07:05:02 user nova-compute[72803]:       </nova:owner>
Aug 15 07:05:02 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:05:02 user nova-compute[72803]:       <nova:ports>
Aug 15 07:05:02 user nova-compute[72803]:         <nova:port uuid="e478da74-bdfe-4812-b471-86d1252ee7e9">
Aug 15 07:05:02 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 07:05:02 user nova-compute[72803]:         </nova:port>
Aug 15 07:05:02 user nova-compute[72803]:       </nova:ports>
Aug 15 07:05:02 user nova-compute[72803]:     </nova:instance>
Aug 15 07:05:02 user nova-compute[72803]:   </metadata>
Aug 15 07:05:02 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:05:02 user nova-compute[72803]:     <system>
Aug 15 07:05:02 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:05:02 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:05:02 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:05:02 user nova-compute[72803]:       <entry name="serial">9c7018fa-ebd1-4446-a8ca-f775ee3a570d</entry>
Aug 15 07:05:02 user nova-compute[72803]:       <entry name="uuid">9c7018fa-ebd1-4446-a8ca-f775ee3a570d</entry>
Aug 15 07:05:02 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:05:02 user nova-compute[72803]:     </system>
Aug 15 07:05:02 user nova-compute[72803]:   </sysinfo>
Aug 15 07:05:02 user nova-compute[72803]:   <os>
Aug 15 07:05:02 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:05:02 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:05:02 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:05:02 user nova-compute[72803]:   </os>
Aug 15 07:05:02 user nova-compute[72803]:   <features>
Aug 15 07:05:02 user nova-compute[72803]:     <acpi/>
Aug 15 07:05:02 user nova-compute[72803]:     <apic/>
Aug 15 07:05:02 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:05:02 user nova-compute[72803]:   </features>
Aug 15 07:05:02 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:05:02 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:05:02 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:05:02 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:05:02 user nova-compute[72803]:   </clock>
Aug 15 07:05:02 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:05:02 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:05:02 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:05:02 user nova-compute[72803]:   </cpu>
Aug 15 07:05:02 user nova-compute[72803]:   <devices>
Aug 15 07:05:02 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:05:02 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:05:02 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk"/>
Aug 15 07:05:02 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:05:02 user nova-compute[72803]:     </disk>
Aug 15 07:05:02 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:05:02 user nova-compute[72803]:       <mac address="fa:16:3e:ee:2c:d1"/>
Aug 15 07:05:02 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:05:02 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:05:02 user nova-compute[72803]:       <target dev="tape478da74-bd"/>
Aug 15 07:05:02 user nova-compute[72803]:     </interface>
Aug 15 07:05:02 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:05:02 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/console.log" append="off"/>
Aug 15 07:05:02 user nova-compute[72803]:     </serial>
Aug 15 07:05:02 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:05:02 user nova-compute[72803]:     <video>
Aug 15 07:05:02 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:05:02 user nova-compute[72803]:     </video>
Aug 15 07:05:02 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:05:02 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:05:02 user nova-compute[72803]:     </rng>
Aug 15 07:05:02 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:05:02 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:05:02 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:05:02 user nova-compute[72803]:     </memballoon>
Aug 15 07:05:02 user nova-compute[72803]:   </devices>
Aug 15 07:05:02 user nova-compute[72803]: </domain>
Aug 15 07:05:02 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1831556221',display_name='tempest-TestServerVolumeAttachmentScenario-server-1831556221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1831556221',id=27,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHZvTG+ebaAm8p7Sv9K1kYncN0VWhzEWdmNYADnuKmNj4mH/1v12Xf8h4qViplCiU7ghKeXaLg5Te4WP9GyPfnXHpYZ/3cQ52x8slG7kKhPmHN1dUN5HVMn2z9f2lBzuw==',key_name='tempest-keypair-1021243406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da8d277cf96f40bb97e19deccb16bc4c',ramdisk_id='',reservation_id='r-n830zulp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-847255380',owner_user_name='tempest-TestServerVolumeAttachmentScenario-847255380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a7b75860c2469b8d1f126f689a5a48',uuid=9c7018fa-ebd1-4446-a8ca-f775ee3a570d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Converting VIF {"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:2c:d1,bridge_name='br-int',has_traffic_filtering=True,id=e478da74-bdfe-4812-b471-86d1252ee7e9,network=Network(1750ab6d-f5be-41dc-9e91-f68f80bb239a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape478da74-bd') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG os_vif [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:2c:d1,bridge_name='br-int',has_traffic_filtering=True,id=e478da74-bdfe-4812-b471-86d1252ee7e9,network=Network(1750ab6d-f5be-41dc-9e91-f68f80bb239a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape478da74-bd') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape478da74-bd, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape478da74-bd, col_values=(('external_ids', {'iface-id': 'e478da74-bdfe-4812-b471-86d1252ee7e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:2c:d1', 'vm-uuid': '9c7018fa-ebd1-4446-a8ca-f775ee3a570d'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:02 user nova-compute[72803]: INFO os_vif [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:2c:d1,bridge_name='br-int',has_traffic_filtering=True,id=e478da74-bdfe-4812-b471-86d1252ee7e9,network=Network(1750ab6d-f5be-41dc-9e91-f68f80bb239a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape478da74-bd')
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:05:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No VIF found with MAC fa:16:3e:ee:2c:d1, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:05:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk /opt/stack/data/nova/instances/snapshots/tmpk_xnz1tq/f484aea0be164c11a72b2464a1bffd88" returned: 0 in 0.600s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:03 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Snapshot extracted, beginning image upload
Aug 15 07:05:03 user nova-compute[72803]: DEBUG nova.network.neutron [req-e4848a4f-59e1-41d4-b4f0-d3e0d1dc6480 req-7099c2a8-cf14-4fb2-8e49-8e173fd69661 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updated VIF entry in instance network info cache for port e478da74-bdfe-4812-b471-86d1252ee7e9. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:05:03 user nova-compute[72803]: DEBUG nova.network.neutron [req-e4848a4f-59e1-41d4-b4f0-d3e0d1dc6480 req-7099c2a8-cf14-4fb2-8e49-8e173fd69661 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updating instance_info_cache with network_info: [{"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e4848a4f-59e1-41d4-b4f0-d3e0d1dc6480 req-7099c2a8-cf14-4fb2-8e49-8e173fd69661 service nova] Releasing lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-32be0b6f-25c0-4ecc-ac37-5f3037f05f0b req-3a616614-b1ef-4713-857d-d1a81f4a9cef service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-32be0b6f-25c0-4ecc-ac37-5f3037f05f0b req-3a616614-b1ef-4713-857d-d1a81f4a9cef service nova] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-32be0b6f-25c0-4ecc-ac37-5f3037f05f0b req-3a616614-b1ef-4713-857d-d1a81f4a9cef service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-32be0b6f-25c0-4ecc-ac37-5f3037f05f0b req-3a616614-b1ef-4713-857d-d1a81f4a9cef service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-32be0b6f-25c0-4ecc-ac37-5f3037f05f0b req-3a616614-b1ef-4713-857d-d1a81f4a9cef service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] No waiting events found dispatching network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:04 user nova-compute[72803]: WARNING nova.compute.manager [req-32be0b6f-25c0-4ecc-ac37-5f3037f05f0b req-3a616614-b1ef-4713-857d-d1a81f4a9cef service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received unexpected event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 07:05:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-8cca613f-a648-416e-b838-9cafe8af347c req-4a4e9720-df7d-47f5-b80c-bdf47b663d5f service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received event network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8cca613f-a648-416e-b838-9cafe8af347c req-4a4e9720-df7d-47f5-b80c-bdf47b663d5f service nova] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8cca613f-a648-416e-b838-9cafe8af347c req-4a4e9720-df7d-47f5-b80c-bdf47b663d5f service nova] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8cca613f-a648-416e-b838-9cafe8af347c req-4a4e9720-df7d-47f5-b80c-bdf47b663d5f service nova] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-8cca613f-a648-416e-b838-9cafe8af347c req-4a4e9720-df7d-47f5-b80c-bdf47b663d5f service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] No waiting events found dispatching network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:04 user nova-compute[72803]: WARNING nova.compute.manager [req-8cca613f-a648-416e-b838-9cafe8af347c req-4a4e9720-df7d-47f5-b80c-bdf47b663d5f service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received unexpected event network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 for instance with vm_state building and task_state spawning.
Aug 15 07:05:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:05 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Snapshot image upload complete
Aug 15 07:05:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:05 user nova-compute[72803]: INFO nova.compute.manager [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Shelve offloading
Aug 15 07:05:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance destroyed successfully.
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquired lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083106.3560429, 9c7018fa-ebd1-4446-a8ca-f775ee3a570d => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:05:06 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] VM Resumed (Lifecycle Event)
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:05:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Instance spawned successfully.
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:05:06 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083106.3571398, 9c7018fa-ebd1-4446-a8ca-f775ee3a570d => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:05:06 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] VM Started (Lifecycle Event)
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updating instance_info_cache with network_info: [{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Releasing lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:05:06 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:05:06 user nova-compute[72803]: INFO nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-c0eb76d0-6b5e-43fb-821f-219078d284eb req-66234609-d0a5-4fa1-bb91-3c1072a81fc0 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received event network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c0eb76d0-6b5e-43fb-821f-219078d284eb req-66234609-d0a5-4fa1-bb91-3c1072a81fc0 service nova] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c0eb76d0-6b5e-43fb-821f-219078d284eb req-66234609-d0a5-4fa1-bb91-3c1072a81fc0 service nova] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c0eb76d0-6b5e-43fb-821f-219078d284eb req-66234609-d0a5-4fa1-bb91-3c1072a81fc0 service nova] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-c0eb76d0-6b5e-43fb-821f-219078d284eb req-66234609-d0a5-4fa1-bb91-3c1072a81fc0 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] No waiting events found dispatching network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:06 user nova-compute[72803]: WARNING nova.compute.manager [req-c0eb76d0-6b5e-43fb-821f-219078d284eb req-66234609-d0a5-4fa1-bb91-3c1072a81fc0 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received unexpected event network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 for instance with vm_state active and task_state None.
Aug 15 07:05:06 user nova-compute[72803]: INFO nova.compute.manager [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Took 7.05 seconds to build instance.
Aug 15 07:05:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e7fb61d-0cbe-4d6f-bade-a03ea5c565f4 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.140s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance destroyed successfully.
Aug 15 07:05:07 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'resources' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1958541110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1958541110',id=23,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv0b0a3ngqM1Rw6ivElDPxaHZTqoncXJY7HEghPOJHNLnPbdeaVX6ny+VQEQQqKJjEj171XZaFPBboIGN/GYnEdB2Fl2X0k60YoU4I4StHZ2sd7s/Pu8YkH906fueCb3w==',key_name='tempest-keypair-312287039',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-nt0tdef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member',shelved_at='2023-08-15T07:05:05.928113',shelved_host='user',shelved_image_id='137fd1c2-9b86-41f3-bd50-ca65e1a97899'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:05:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=56b3f17c-680b-4cbc-ad5a-26ec9f4ee154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG os_vif [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap390036c0-19, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:05:07 user nova-compute[72803]: INFO os_vif [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19')
Aug 15 07:05:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Deleting instance files /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154_del
Aug 15 07:05:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Deletion of /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154_del complete
Aug 15 07:05:07 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Deleted allocations for instance 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154
Aug 15 07:05:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'numa_topology' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e93d9902-d768-484f-99f0-bde66394edc6 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.193s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:09 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083094.6252742, 52b19720-9992-4994-ab65-aae046dcfc54 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:05:09 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] VM Stopped (Lifecycle Event)
Aug 15 07:05:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af32f84f-cd5e-40d3-8acb-7b54e6ac14f9 None None] [instance: 52b19720-9992-4994-ab65-aae046dcfc54] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:15 user nova-compute[72803]: INFO nova.compute.manager [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Terminating instance
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-71abe6bf-28b9-47b9-a7a9-e5fb0efca14f req-ae20d0cb-23c1-4a4e-8be6-5302ca2ceff5 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-unplugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71abe6bf-28b9-47b9-a7a9-e5fb0efca14f req-ae20d0cb-23c1-4a4e-8be6-5302ca2ceff5 service nova] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71abe6bf-28b9-47b9-a7a9-e5fb0efca14f req-ae20d0cb-23c1-4a4e-8be6-5302ca2ceff5 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71abe6bf-28b9-47b9-a7a9-e5fb0efca14f req-ae20d0cb-23c1-4a4e-8be6-5302ca2ceff5 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-71abe6bf-28b9-47b9-a7a9-e5fb0efca14f req-ae20d0cb-23c1-4a4e-8be6-5302ca2ceff5 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] No waiting events found dispatching network-vif-unplugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-71abe6bf-28b9-47b9-a7a9-e5fb0efca14f req-ae20d0cb-23c1-4a4e-8be6-5302ca2ceff5 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-unplugged-b3c670dd-02a1-4d2c-867a-450884798f63 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Instance destroyed successfully.
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'resources' on Instance uuid 06a22c66-fe35-4c52-aef9-9801f38d2832 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T06:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-434501159',display_name='tempest-ServerActionsTestOtherA-server-221183768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-434501159',id=16,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUZ/EwNsA5ruMIw3IDFFAGkJQBK1O6/57tM7BxohUJ7SYDtPC3cHhbHxvpQ+BwkgtdivuuuprwjP+NluswpG70oDt4GOKuJikiDEf0XWiaJ8X18OMWn/ICQApxHaZ4GAQ==',key_name='tempest-keypair-2020809915',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-9c6fhw9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:01:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=06a22c66-fe35-4c52-aef9-9801f38d2832,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "b3c670dd-02a1-4d2c-867a-450884798f63", "address": "fa:16:3e:96:fd:20", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3c670dd-02", "ovs_interfaceid": "b3c670dd-02a1-4d2c-867a-450884798f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG os_vif [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3c670dd-02, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:05:15 user nova-compute[72803]: INFO os_vif [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:fd:20,bridge_name='br-int',has_traffic_filtering=True,id=b3c670dd-02a1-4d2c-867a-450884798f63,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3c670dd-02')
Aug 15 07:05:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Deleting instance files /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832_del
Aug 15 07:05:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Deletion of /opt/stack/data/nova/instances/06a22c66-fe35-4c52-aef9-9801f38d2832_del complete
Aug 15 07:05:15 user nova-compute[72803]: INFO nova.compute.manager [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 07:05:15 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:05:15 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:05:16 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:16 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Took 0.73 seconds to deallocate network for instance.
Aug 15 07:05:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:17 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Deleted allocations for instance 06a22c66-fe35-4c52-aef9-9801f38d2832
Aug 15 07:05:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7bb3318b-0fc9-465d-865a-13e35a59e7ad tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-c457eb7e-c9ea-491f-8daa-8618fc58c7e0 req-737fcc17-d557-4eb5-bdbd-90a6bea130d4 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c457eb7e-c9ea-491f-8daa-8618fc58c7e0 req-737fcc17-d557-4eb5-bdbd-90a6bea130d4 service nova] Acquiring lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c457eb7e-c9ea-491f-8daa-8618fc58c7e0 req-737fcc17-d557-4eb5-bdbd-90a6bea130d4 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c457eb7e-c9ea-491f-8daa-8618fc58c7e0 req-737fcc17-d557-4eb5-bdbd-90a6bea130d4 service nova] Lock "06a22c66-fe35-4c52-aef9-9801f38d2832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-c457eb7e-c9ea-491f-8daa-8618fc58c7e0 req-737fcc17-d557-4eb5-bdbd-90a6bea130d4 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] No waiting events found dispatching network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:17 user nova-compute[72803]: WARNING nova.compute.manager [req-c457eb7e-c9ea-491f-8daa-8618fc58c7e0 req-737fcc17-d557-4eb5-bdbd-90a6bea130d4 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received unexpected event network-vif-plugged-b3c670dd-02a1-4d2c-867a-450884798f63 for instance with vm_state deleted and task_state None.
Aug 15 07:05:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-c457eb7e-c9ea-491f-8daa-8618fc58c7e0 req-737fcc17-d557-4eb5-bdbd-90a6bea130d4 service nova] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Received event network-vif-deleted-b3c670dd-02a1-4d2c-867a-450884798f63 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:17 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083102.4985545, 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:05:17 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] VM Stopped (Lifecycle Event)
Aug 15 07:05:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-792fb7b2-1030-4129-96f9-a34fa55318f5 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:25 user nova-compute[72803]: INFO nova.compute.manager [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Terminating instance
Aug 15 07:05:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-61a4de09-16a8-41e5-a3a6-6c9ef80908e8 req-dd1e506c-a90e-4936-b09e-e51c29bafd63 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received event network-vif-unplugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-61a4de09-16a8-41e5-a3a6-6c9ef80908e8 req-dd1e506c-a90e-4936-b09e-e51c29bafd63 service nova] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-61a4de09-16a8-41e5-a3a6-6c9ef80908e8 req-dd1e506c-a90e-4936-b09e-e51c29bafd63 service nova] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-61a4de09-16a8-41e5-a3a6-6c9ef80908e8 req-dd1e506c-a90e-4936-b09e-e51c29bafd63 service nova] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-61a4de09-16a8-41e5-a3a6-6c9ef80908e8 req-dd1e506c-a90e-4936-b09e-e51c29bafd63 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] No waiting events found dispatching network-vif-unplugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-61a4de09-16a8-41e5-a3a6-6c9ef80908e8 req-dd1e506c-a90e-4936-b09e-e51c29bafd63 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received event network-vif-unplugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:05:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Instance destroyed successfully.
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.objects.instance [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'resources' on Instance uuid f5cf8ddf-e3c0-403e-91ff-ca1233b33576 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323940789',display_name='tempest-AttachVolumeNegativeTest-server-1323940789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323940789',id=20,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIodbd/VmZQ62+n4oaG12QN2fp86CGbygXI7eJaL+QVPx9ysUWQ3zPv5zkbGh+1HuCj0IX2UAFXV3yZK7YESlKcpRYi2Q1krhDVPZCdl7gnUeFOLGWPK2AuKmVTWHfz/UQ==',key_name='tempest-keypair-775690106',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:02:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-4tr4egmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=f5cf8ddf-e3c0-403e-91ff-ca1233b33576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "address": "fa:16:3e:f1:f6:51", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7aa521d7-60", "ovs_interfaceid": "7aa521d7-60f7-4b67-836d-1c4e6bd8c131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=7aa521d7-60f7-4b67-836d-1c4e6bd8c131,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa521d7-60') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG os_vif [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=7aa521d7-60f7-4b67-836d-1c4e6bd8c131,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa521d7-60') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7aa521d7-60, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:05:26 user nova-compute[72803]: INFO os_vif [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=7aa521d7-60f7-4b67-836d-1c4e6bd8c131,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7aa521d7-60')
Aug 15 07:05:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Deleting instance files /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576_del
Aug 15 07:05:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Deletion of /opt/stack/data/nova/instances/f5cf8ddf-e3c0-403e-91ff-ca1233b33576_del complete
Aug 15 07:05:26 user nova-compute[72803]: INFO nova.compute.manager [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 15 07:05:26 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:05:26 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:05:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-730a17e1-b082-42b3-bd3c-36f73607b91d req-65aae22d-6b08-432b-a4d3-02f8268ff2eb service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received event network-vif-deleted-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:27 user nova-compute[72803]: INFO nova.compute.manager [req-730a17e1-b082-42b3-bd3c-36f73607b91d req-65aae22d-6b08-432b-a4d3-02f8268ff2eb service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Neutron deleted interface 7aa521d7-60f7-4b67-836d-1c4e6bd8c131; detaching it from the instance and deleting it from the info cache
Aug 15 07:05:27 user nova-compute[72803]: DEBUG nova.network.neutron [req-730a17e1-b082-42b3-bd3c-36f73607b91d req-65aae22d-6b08-432b-a4d3-02f8268ff2eb service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:27 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-730a17e1-b082-42b3-bd3c-36f73607b91d req-65aae22d-6b08-432b-a4d3-02f8268ff2eb service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Detach interface failed, port_id=7aa521d7-60f7-4b67-836d-1c4e6bd8c131, reason: Instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:05:27 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Took 0.86 seconds to deallocate network for instance.
Aug 15 07:05:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-5515b1b4-e37d-4cbe-8bf9-deb565d956e4 req-ee7d7a82-7a7e-4d53-bbcf-2ae551e038c6 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received event network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5515b1b4-e37d-4cbe-8bf9-deb565d956e4 req-ee7d7a82-7a7e-4d53-bbcf-2ae551e038c6 service nova] Acquiring lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5515b1b4-e37d-4cbe-8bf9-deb565d956e4 req-ee7d7a82-7a7e-4d53-bbcf-2ae551e038c6 service nova] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5515b1b4-e37d-4cbe-8bf9-deb565d956e4 req-ee7d7a82-7a7e-4d53-bbcf-2ae551e038c6 service nova] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-5515b1b4-e37d-4cbe-8bf9-deb565d956e4 req-ee7d7a82-7a7e-4d53-bbcf-2ae551e038c6 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] No waiting events found dispatching network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:28 user nova-compute[72803]: WARNING nova.compute.manager [req-5515b1b4-e37d-4cbe-8bf9-deb565d956e4 req-ee7d7a82-7a7e-4d53-bbcf-2ae551e038c6 service nova] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Received unexpected event network-vif-plugged-7aa521d7-60f7-4b67-836d-1c4e6bd8c131 for instance with vm_state deleted and task_state None.
Aug 15 07:05:28 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:05:28 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:05:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:28 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Deleted allocations for instance f5cf8ddf-e3c0-403e-91ff-ca1233b33576
Aug 15 07:05:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9296b096-9ebb-40b9-8846-97c9d285b68c tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f5cf8ddf-e3c0-403e-91ff-ca1233b33576" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.535s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-b5a3b762-c43c-41e1-b02f-cfd1007a1df7 req-f0100c08-662c-4a7f-91a6-6305b4fbea1d service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-changed-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-b5a3b762-c43c-41e1-b02f-cfd1007a1df7 req-f0100c08-662c-4a7f-91a6-6305b4fbea1d service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Refreshing instance network info cache due to event network-changed-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b5a3b762-c43c-41e1-b02f-cfd1007a1df7 req-f0100c08-662c-4a7f-91a6-6305b4fbea1d service nova] Acquiring lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b5a3b762-c43c-41e1-b02f-cfd1007a1df7 req-f0100c08-662c-4a7f-91a6-6305b4fbea1d service nova] Acquired lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-b5a3b762-c43c-41e1-b02f-cfd1007a1df7 req-f0100c08-662c-4a7f-91a6-6305b4fbea1d service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Refreshing network info cache for port 0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.objects.instance [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'flavor' on Instance uuid 59123d08-1213-4b26-865e-8a12efde9744 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:30 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Ignoring supplied device name: /dev/vdb
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:30 user nova-compute[72803]: INFO nova.compute.manager [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Attaching volume 62f63db7-8dd3-4cae-a725-85e3fca9ebb4 to /dev/vdb
Aug 15 07:05:30 user nova-compute[72803]: DEBUG os_brick.utils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-b5a3b762-c43c-41e1-b02f-cfd1007a1df7 req-f0100c08-662c-4a7f-91a6-6305b4fbea1d service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Updated VIF entry in instance network info cache for port 0b2c94f6-afae-4e9d-b856-c8f2c9efe1db. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-b5a3b762-c43c-41e1-b02f-cfd1007a1df7 req-f0100c08-662c-4a7f-91a6-6305b4fbea1d service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Updating instance_info_cache with network_info: [{"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca584a3-8208-4388-9ef0-23b4e92ab590]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b5a3b762-c43c-41e1-b02f-cfd1007a1df7 req-f0100c08-662c-4a7f-91a6-6305b4fbea1d service nova] Releasing lock "refresh_cache-59123d08-1213-4b26-865e-8a12efde9744" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8695ff68-b54d-466b-ab7b-d5c06d13eaec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd1127-cb6b-426e-a011-8566bc786f8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf96c0-e146-4379-806f-96295032ee88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:05:30 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:05:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[15812b6d-7911-4a6d-92e8-2c503cb7fc58]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG os_brick.utils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Updating existing volume attachment record: 3db965ba-2c3d-435b-b4ab-5ba2837614cb {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083115.8419313, 06a22c66-fe35-4c52-aef9-9801f38d2832 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:05:30 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] VM Stopped (Lifecycle Event)
Aug 15 07:05:30 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8782ef4-4980-41d7-a268-1148431b7b80 None None] [instance: 06a22c66-fe35-4c52-aef9-9801f38d2832] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:05:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:35 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:05:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:05:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:05:36 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "bd737048-02f4-4dc3-b386-202d96fd5425" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "bd737048-02f4-4dc3-b386-202d96fd5425" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:37 user nova-compute[72803]: INFO nova.compute.manager [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Terminating instance
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-50245b40-b3ed-4c7f-82ff-792797cccc3a req-7a3515c4-36ef-4fa5-9690-57af3e2aa6d6 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received event network-vif-unplugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-50245b40-b3ed-4c7f-82ff-792797cccc3a req-7a3515c4-36ef-4fa5-9690-57af3e2aa6d6 service nova] Acquiring lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-50245b40-b3ed-4c7f-82ff-792797cccc3a req-7a3515c4-36ef-4fa5-9690-57af3e2aa6d6 service nova] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-50245b40-b3ed-4c7f-82ff-792797cccc3a req-7a3515c4-36ef-4fa5-9690-57af3e2aa6d6 service nova] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-50245b40-b3ed-4c7f-82ff-792797cccc3a req-7a3515c4-36ef-4fa5-9690-57af3e2aa6d6 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] No waiting events found dispatching network-vif-unplugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-50245b40-b3ed-4c7f-82ff-792797cccc3a req-7a3515c4-36ef-4fa5-9690-57af3e2aa6d6 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received event network-vif-unplugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:05:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Instance destroyed successfully.
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.objects.instance [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lazy-loading 'resources' on Instance uuid bd737048-02f4-4dc3-b386-202d96fd5425 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-883257000',display_name='tempest-VolumesActionsTest-instance-883257000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-883257000',id=24,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be5a3574f4f34ed0be6736c3f3bfc593',ramdisk_id='',reservation_id='r-0bkzivvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-171960212',owner_user_name='tempest-VolumesActionsTest-171960212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:03:44Z,user_data=None,user_id='3529639076634804b4bee814a03fc2c2',uuid=bd737048-02f4-4dc3-b386-202d96fd5425,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Converting VIF {"id": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "address": "fa:16:3e:9f:84:2c", "network": {"id": "cedc471c-bac3-45bc-9ce9-460effcf98ca", "bridge": "br-int", "label": "tempest-VolumesActionsTest-395417254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be5a3574f4f34ed0be6736c3f3bfc593", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8468a36-f4", "ovs_interfaceid": "e8468a36-f4d4-44e8-8140-e6117dcb3338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:84:2c,bridge_name='br-int',has_traffic_filtering=True,id=e8468a36-f4d4-44e8-8140-e6117dcb3338,network=Network(cedc471c-bac3-45bc-9ce9-460effcf98ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8468a36-f4') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG os_vif [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:84:2c,bridge_name='br-int',has_traffic_filtering=True,id=e8468a36-f4d4-44e8-8140-e6117dcb3338,network=Network(cedc471c-bac3-45bc-9ce9-460effcf98ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8468a36-f4') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8468a36-f4, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:05:37 user nova-compute[72803]: INFO os_vif [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:84:2c,bridge_name='br-int',has_traffic_filtering=True,id=e8468a36-f4d4-44e8-8140-e6117dcb3338,network=Network(cedc471c-bac3-45bc-9ce9-460effcf98ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8468a36-f4')
Aug 15 07:05:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Deleting instance files /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425_del
Aug 15 07:05:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Deletion of /opt/stack/data/nova/instances/bd737048-02f4-4dc3-b386-202d96fd5425_del complete
Aug 15 07:05:37 user nova-compute[72803]: INFO nova.compute.manager [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 15 07:05:37 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:05:37 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:05:38 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:05:38 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Took 0.56 seconds to deallocate network for instance.
Aug 15 07:05:38 user nova-compute[72803]: DEBUG nova.compute.manager [req-bd0f3134-1cfc-49d4-85ec-c3b114c5c07e req-0f23b9c1-7370-445a-a38d-6ec19aeef618 service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received event network-vif-deleted-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:38 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:05:38 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:05:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:38 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Deleted allocations for instance bd737048-02f4-4dc3-b386-202d96fd5425
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6537004e-7fac-4558-841d-60266e20bf07 tempest-VolumesActionsTest-171960212 tempest-VolumesActionsTest-171960212-project-member] Lock "bd737048-02f4-4dc3-b386-202d96fd5425" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.828s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-9859d217-1799-4646-8f7e-31cb4ce0e74d req-5873377b-6311-4ddb-bf73-162774e2200a service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received event network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9859d217-1799-4646-8f7e-31cb4ce0e74d req-5873377b-6311-4ddb-bf73-162774e2200a service nova] Acquiring lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9859d217-1799-4646-8f7e-31cb4ce0e74d req-5873377b-6311-4ddb-bf73-162774e2200a service nova] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9859d217-1799-4646-8f7e-31cb4ce0e74d req-5873377b-6311-4ddb-bf73-162774e2200a service nova] Lock "bd737048-02f4-4dc3-b386-202d96fd5425-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-9859d217-1799-4646-8f7e-31cb4ce0e74d req-5873377b-6311-4ddb-bf73-162774e2200a service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] No waiting events found dispatching network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:05:39 user nova-compute[72803]: WARNING nova.compute.manager [req-9859d217-1799-4646-8f7e-31cb4ce0e74d req-5873377b-6311-4ddb-bf73-162774e2200a service nova] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Received unexpected event network-vif-plugged-e8468a36-f4d4-44e8-8140-e6117dcb3338 for instance with vm_state deleted and task_state None.
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qeLQszEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:05:39 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:05:39 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:05:39 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cb42bb-accf-4db1-ab27-067eaf0eef50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:05:39 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b99860-1744-4c6b-ace7-faabb8d39985]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4] added
Aug 15 07:05:39 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1671fe6-5e26-4390-af75-c1caa18ae833]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3b1111-559b-4eb2-b160-6e85a20cbd96]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qeLQszEM {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qeLQszEM" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e0053-8ba7-4c52-8d48-d33f8476b627]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qeLQszEM'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee87c00-cf14-4c39-8720-1ef1964a8fd1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd1877-971a-4f3d-a040-4a7e896082d8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:05:39 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:05:39 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:05:39 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:05:39 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2a65bc-4b31-4355-a940-651a0aa299c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4, portal: 172.16.0.220,3260]
Aug 15 07:05:39 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4, portal: 172.16.0.220,3260] successful.
Aug 15 07:05:39 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:39 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44725c3-6003-4718-9ee8-3e849a30dd54]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1520d745-1e79-4764-998b-595ea66550fb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:05:40 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:05:40 user nova-compute[72803]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)
Aug 15 07:05:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:05:40 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:05:40 user nova-compute[72803]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)
Aug 15 07:05:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a62118-d630-41cf-a271-c8e86ff000b3]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:05:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qeLQszEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23935323861333732', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935323861333732', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG nova.objects.instance [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'flavor' on Instance uuid 59123d08-1213-4b26-865e-8a12efde9744 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:05:41 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:05:41 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:05:41 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:05:41 user nova-compute[72803]:   <serial>62f63db7-8dd3-4cae-a725-85e3fca9ebb4</serial>
Aug 15 07:05:41 user nova-compute[72803]: </disk>
Aug 15 07:05:41 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083126.5002506, f5cf8ddf-e3c0-403e-91ff-ca1233b33576 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:05:41 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] VM Stopped (Lifecycle Event)
Aug 15 07:05:41 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8aab6dd7-bc9a-4657-8ce3-4cc62f7baae4 None None] [instance: f5cf8ddf-e3c0-403e-91ff-ca1233b33576] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No VIF found with MAC fa:16:3e:02:0f:13, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0b9bbd53-8d86-44e5-ae79-7b53851f00fb tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.098s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:43 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:05:43 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7473MB free_disk=25.423442840576172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 59123d08-1213-4b26-865e-8a12efde9744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:05:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:05:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:47 user nova-compute[72803]: INFO nova.compute.manager [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] instance snapshotting
Aug 15 07:05:47 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Beginning live snapshot process
Aug 15 07:05:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json -f qcow2 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json -f qcow2 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0e0symnz/d7f0eb61e4a748aeb7d06173b7feed08.delta 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0e0symnz/d7f0eb61e4a748aeb7d06173b7feed08.delta 1073741824" returned: 0 in 0.058s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:47 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 07:05:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 07:05:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 07:05:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 07:05:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:49 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:05:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0e0symnz/d7f0eb61e4a748aeb7d06173b7feed08.delta /opt/stack/data/nova/instances/snapshots/tmp0e0symnz/d7f0eb61e4a748aeb7d06173b7feed08 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:05:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0e0symnz/d7f0eb61e4a748aeb7d06173b7feed08.delta /opt/stack/data/nova/instances/snapshots/tmp0e0symnz/d7f0eb61e4a748aeb7d06173b7feed08" returned: 0 in 0.638s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:05:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Snapshot extracted, beginning image upload
Aug 15 07:05:52 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Snapshot image upload complete
Aug 15 07:05:52 user nova-compute[72803]: INFO nova.compute.manager [None req-6f054f45-0ece-41de-86fd-01cd39c53793 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Took 5.29 seconds to snapshot the instance on the hypervisor.
Aug 15 07:05:52 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083137.7981277, bd737048-02f4-4dc3-b386-202d96fd5425 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:05:52 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] VM Stopped (Lifecycle Event)
Aug 15 07:05:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-28d47f5d-1560-4342-8651-6ecbb13626a1 None None] [instance: bd737048-02f4-4dc3-b386-202d96fd5425] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:05:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:05:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:05:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:05:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:05:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:05:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:09 user nova-compute[72803]: INFO nova.compute.manager [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Unshelving
Aug 15 07:06:09 user nova-compute[72803]: INFO nova.virt.block_device [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Booting with volume 12fd62d1-26cb-42f9-a2c5-9b601d7fac9a at /dev/vda
Aug 15 07:06:10 user nova-compute[72803]: DEBUG os_brick.utils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47bbd9-4805-476e-ba59-db7fdc21eebe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef33e38-5117-4e95-a6a7-b27ebccdb730]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f067f-a20e-4ac7-925b-e5883064c7ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[643189fe-adc1-4851-80a7-7ce8c1ad7555]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:06:10 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:06:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d33981-846a-4d48-b8b4-0367789467ab]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG os_brick.utils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:06:10 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating existing volume attachment record: 256d7534-92ac-46e0-8e5f-0fe7ed90a856 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:06:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:06:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:06:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:06:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:06:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:19 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lazy-loading 'pci_requests' on Instance uuid 506ed7b9-6081-418b-86a8-278db430893e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:19 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lazy-loading 'numa_topology' on Instance uuid 506ed7b9-6081-418b-86a8-278db430893e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:19 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:06:19 user nova-compute[72803]: INFO nova.compute.claims [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Claim successful on node user
Aug 15 07:06:20 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:06:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:06:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:20 user nova-compute[72803]: INFO nova.network.neutron [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating port 2e2cc686-e80f-439a-87d6-36f6b8dba07d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 07:06:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:06:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:06:20 user nova-compute[72803]: INFO nova.compute.claims [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Claim successful on node user
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquired lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-e61c0433-e14e-44fa-b862-20c7452f5ad8 req-ff12d3da-1870-455f-93ec-c17191ea544e service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-e61c0433-e14e-44fa-b862-20c7452f5ad8 req-ff12d3da-1870-455f-93ec-c17191ea544e service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing instance network info cache due to event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e61c0433-e14e-44fa-b862-20c7452f5ad8 req-ff12d3da-1870-455f-93ec-c17191ea544e service nova] Acquiring lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:06:21 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.policy [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50b2d95238654df88548e1549fa73210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3743fde3d93f4fed84b52926dadc07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:06:21 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Creating image(s)
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "/opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "/opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Releasing lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:06:21 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Creating image(s)
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Ensure instance console log exists: /opt/stack/data/nova/instances/506ed7b9-6081-418b-86a8-278db430893e/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Start _get_guest_xml network_info=[{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '256d7534-92ac-46e0-8e5f-0fe7ed90a856', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxVByZMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '506ed7b9-6081-418b-86a8-278db430893e', 'attached_at': '', 'detached_at': '', 'volume_id': '12fd62d1-26cb-42f9-a2c5-9b601d7fac9a', 'serial': '12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e61c0433-e14e-44fa-b862-20c7452f5ad8 req-ff12d3da-1870-455f-93ec-c17191ea544e service nova] Acquired lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.network.neutron [req-e61c0433-e14e-44fa-b862-20c7452f5ad8 req-ff12d3da-1870-455f-93ec-c17191ea544e service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:06:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:06:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lazy-loading 'vcpu_model' on Instance uuid 506ed7b9-6081-418b-86a8-278db430893e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxVByZMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:06:21 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:06:21 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:06:21 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef083d-da32-44cd-b5bc-fdfa453e033f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:06:21 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[085fe4d0-fd80-41a6-ae8d-80d354df79fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a] added
Aug 15 07:06:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25fbe0c-d0fc-4613-97ed-0f5c5eaee28b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:21 user nova-compute[72803]: INFO nova.compute.manager [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Detaching volume 62f63db7-8dd3-4cae-a725-85e3fca9ebb4
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[178b0b93-96e9-42ca-98fb-cedc3a186f6d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxVByZMq {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxVByZMq" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b21a1e-8709-4faf-9f30-df280bcd1f5e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DxVByZMq'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:21 user nova-compute[72803]: INFO nova.virt.block_device [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Attempting to driver detach volume 62f63db7-8dd3-4cae-a725-85e3fca9ebb4 from mountpoint /dev/vdb
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1091e-609e-40b9-93eb-4beb38ab17e2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Attempting to detach device vdb from instance 59123d08-1213-4b26-865e-8a12efde9744 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:06:22 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:06:22 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:06:22 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:06:22 user nova-compute[72803]:   <serial>62f63db7-8dd3-4cae-a725-85e3fca9ebb4</serial>
Aug 15 07:06:22 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:06:22 user nova-compute[72803]: </disk>
Aug 15 07:06:22 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eee0a03-9b45-4ba9-b28d-6c80c645317f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Successfully detached device vdb from instance 59123d08-1213-4b26-865e-8a12efde9744 from the persistent domain config.
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59123d08-1213-4b26-865e-8a12efde9744 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:06:22 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:06:22 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:06:22 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:06:22 user nova-compute[72803]:   <serial>62f63db7-8dd3-4cae-a725-85e3fca9ebb4</serial>
Aug 15 07:06:22 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:06:22 user nova-compute[72803]: </disk>
Aug 15 07:06:22 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.215s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk 1073741824" returned: 0 in 0.062s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75d7b13-80e4-4241-88e8-cdc91c6686b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260]
Aug 15 07:06:22 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260] successful.
Aug 15 07:06:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfdf423-7407-4cc1-8d6c-bd6693a13de3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[221970b7-b461-43b0-ab5e-f8548b9d48d6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)
Aug 15 07:06:22 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab775a20-4705-49c7-8132-849f1313941f]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxVByZMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Successfully created port: 6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.196s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.network.neutron [req-e61c0433-e14e-44fa-b862-20c7452f5ad8 req-ff12d3da-1870-455f-93ec-c17191ea544e service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updated VIF entry in instance network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.network.neutron [req-e61c0433-e14e-44fa-b862-20c7452f5ad8 req-ff12d3da-1870-455f-93ec-c17191ea544e service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e61c0433-e14e-44fa-b862-20c7452f5ad8 req-ff12d3da-1870-455f-93ec-c17191ea544e service nova] Releasing lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083182.487751, 59123d08-1213-4b26-865e-8a12efde9744 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59123d08-1213-4b26-865e-8a12efde9744 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:06:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Successfully detached device vdb from instance 59123d08-1213-4b26-865e-8a12efde9744 from the live domain config.
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qeLQszEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:06:22 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:06:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Cannot resize image /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.objects.instance [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'migration_context' on Instance uuid cfc0cd92-5f09-4726-85ec-102c2d6cefb1 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Ensure instance console log exists: /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26461643736376433', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461643736376433', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.733s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da49f72-e2cb-4916-aa88-46ba16f65b63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1082719568',display_name='tempest-TestShelveInstance-server-1082719568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1082719568',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2020944849',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ba0ba51fa2449daae318ca760c32784',ramdisk_id='',reservation_id='r-pyv4bacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1431210887',owner_user_name='tempest-TestShelveInstance-1431210887-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:06:10Z,user_data=None,user_id='10b9814cfdf2413c9d0ed361ed3aa46d',uuid=506ed7b9-6081-418b-86a8-278db430893e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converting VIF {"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lazy-loading 'pci_devices' on Instance uuid 506ed7b9-6081-418b-86a8-278db430893e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:06:23 user nova-compute[72803]:   <uuid>506ed7b9-6081-418b-86a8-278db430893e</uuid>
Aug 15 07:06:23 user nova-compute[72803]:   <name>instance-00000013</name>
Aug 15 07:06:23 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:06:23 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:06:23 user nova-compute[72803]:   <metadata>
Aug 15 07:06:23 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:06:23 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:name>tempest-TestShelveInstance-server-1082719568</nova:name>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:06:21</nova:creationTime>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:06:23 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:06:23 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:owner>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:user uuid="10b9814cfdf2413c9d0ed361ed3aa46d">tempest-TestShelveInstance-1431210887-project-member</nova:user>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:project uuid="0ba0ba51fa2449daae318ca760c32784">tempest-TestShelveInstance-1431210887</nova:project>
Aug 15 07:06:23 user nova-compute[72803]:       </nova:owner>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:ports>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:port uuid="2e2cc686-e80f-439a-87d6-36f6b8dba07d">
Aug 15 07:06:23 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 07:06:23 user nova-compute[72803]:         </nova:port>
Aug 15 07:06:23 user nova-compute[72803]:       </nova:ports>
Aug 15 07:06:23 user nova-compute[72803]:     </nova:instance>
Aug 15 07:06:23 user nova-compute[72803]:   </metadata>
Aug 15 07:06:23 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:06:23 user nova-compute[72803]:     <system>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="serial">506ed7b9-6081-418b-86a8-278db430893e</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="uuid">506ed7b9-6081-418b-86a8-278db430893e</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:06:23 user nova-compute[72803]:     </system>
Aug 15 07:06:23 user nova-compute[72803]:   </sysinfo>
Aug 15 07:06:23 user nova-compute[72803]:   <os>
Aug 15 07:06:23 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:06:23 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:06:23 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:06:23 user nova-compute[72803]:   </os>
Aug 15 07:06:23 user nova-compute[72803]:   <features>
Aug 15 07:06:23 user nova-compute[72803]:     <acpi/>
Aug 15 07:06:23 user nova-compute[72803]:     <apic/>
Aug 15 07:06:23 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:06:23 user nova-compute[72803]:   </features>
Aug 15 07:06:23 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:06:23 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:06:23 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:06:23 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:06:23 user nova-compute[72803]:   </clock>
Aug 15 07:06:23 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:06:23 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:06:23 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:06:23 user nova-compute[72803]:   </cpu>
Aug 15 07:06:23 user nova-compute[72803]:   <devices>
Aug 15 07:06:23 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:06:23 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:06:23 user nova-compute[72803]:       <source dev="/dev/sdd"/>
Aug 15 07:06:23 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:06:23 user nova-compute[72803]:       <serial>12fd62d1-26cb-42f9-a2c5-9b601d7fac9a</serial>
Aug 15 07:06:23 user nova-compute[72803]:     </disk>
Aug 15 07:06:23 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:06:23 user nova-compute[72803]:       <mac address="fa:16:3e:75:c6:b7"/>
Aug 15 07:06:23 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:06:23 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:06:23 user nova-compute[72803]:       <target dev="tap2e2cc686-e8"/>
Aug 15 07:06:23 user nova-compute[72803]:     </interface>
Aug 15 07:06:23 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:06:23 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/506ed7b9-6081-418b-86a8-278db430893e/console.log" append="off"/>
Aug 15 07:06:23 user nova-compute[72803]:     </serial>
Aug 15 07:06:23 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:06:23 user nova-compute[72803]:     <video>
Aug 15 07:06:23 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:06:23 user nova-compute[72803]:     </video>
Aug 15 07:06:23 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:06:23 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:06:23 user nova-compute[72803]:     </rng>
Aug 15 07:06:23 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:06:23 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:06:23 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:06:23 user nova-compute[72803]:     </memballoon>
Aug 15 07:06:23 user nova-compute[72803]:   </devices>
Aug 15 07:06:23 user nova-compute[72803]: </domain>
Aug 15 07:06:23 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1082719568',display_name='tempest-TestShelveInstance-server-1082719568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1082719568',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2020944849',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0ba0ba51fa2449daae318ca760c32784',ramdisk_id='',reservation_id='r-pyv4bacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1431210887',owner_user_name='tempest-TestShelveInstance-1431210887-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:06:10Z,user_data=None,user_id='10b9814cfdf2413c9d0ed361ed3aa46d',uuid=506ed7b9-6081-418b-86a8-278db430893e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converting VIF {"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_vif [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97eea4d-e436-434e-a90f-0f6499c2b0a2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:23 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:06:23 user nova-compute[72803]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)
Aug 15 07:06:23 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:23 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:06:23 user nova-compute[72803]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 (non-flash)
Aug 15 07:06:23 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e0389900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e2cc686-e8, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e2cc686-e8, col_values=(('external_ids', {'iface-id': '2e2cc686-e80f-439a-87d6-36f6b8dba07d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:c6:b7', 'vm-uuid': '506ed7b9-6081-418b-86a8-278db430893e'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: INFO os_vif [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8')
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2f52c2-d6ab-425c-bb47-b3ea461b3fb6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Successfully updated port: 6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquired lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff01f614-9e8f-45f3-9735-f818d80bf544]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f2d68b-f60d-4785-88ca-66b2b8d5ae23]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] No VIF found with MAC fa:16:3e:75:c6:b7, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[df02076b-c74d-46db-941b-e6c896dcdcbe]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6a4078-af80-4c14-925c-fd4a3216f283]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[080fe2f2-b879-4268-9001-6d48640d48cd]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4, portal: 172.16.0.220,3260]
Aug 15 07:06:23 user nova-compute[72803]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4, portal: 172.16.0.220,3260] successful.
Aug 15 07:06:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-08fcd324-1beb-41b0-9cb2-fa0d52ae3e3a req-fc3f9914-4eba-48af-917f-28556faa4920 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received event network-changed-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-08fcd324-1beb-41b0-9cb2-fa0d52ae3e3a req-fc3f9914-4eba-48af-917f-28556faa4920 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Refreshing instance network info cache due to event network-changed-6609e26a-f730-45fe-b69c-f2ae2c72afc3. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-08fcd324-1beb-41b0-9cb2-fa0d52ae3e3a req-fc3f9914-4eba-48af-917f-28556faa4920 service nova] Acquiring lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac499848-7759-4a54-a3f8-7edc2726e391]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] <== disconnect_volume: return (1083ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Updating instance_info_cache with network_info: [{"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Releasing lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Instance network_info: |[{"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-08fcd324-1beb-41b0-9cb2-fa0d52ae3e3a req-fc3f9914-4eba-48af-917f-28556faa4920 service nova] Acquired lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-08fcd324-1beb-41b0-9cb2-fa0d52ae3e3a req-fc3f9914-4eba-48af-917f-28556faa4920 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Refreshing network info cache for port 6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Start _get_guest_xml network_info=[{"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:06:23 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:06:23 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2076010410',display_name='tempest-AttachVolumeNegativeTest-server-2076010410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2076010410',id=28,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOJTyTF0mLch0E2+pgJC+MZZhWACCUm1rDkRqfCbTKxjvf9xVmc6wNgvPaMDYkOM6452OiY5RJnWANSHJpOR1he4ydC3hLtmM+qFyB/eYW2kD6ywHFrOryORQqIsfYBrw==',key_name='tempest-keypair-467273894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-q5lzv68p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=cfc0cd92-5f09-4726-85ec-102c2d6cefb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=6609e26a-f730-45fe-b69c-f2ae2c72afc3,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6609e26a-f7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'pci_devices' on Instance uuid cfc0cd92-5f09-4726-85ec-102c2d6cefb1 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:06:23 user nova-compute[72803]:   <uuid>cfc0cd92-5f09-4726-85ec-102c2d6cefb1</uuid>
Aug 15 07:06:23 user nova-compute[72803]:   <name>instance-0000001c</name>
Aug 15 07:06:23 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:06:23 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:06:23 user nova-compute[72803]:   <metadata>
Aug 15 07:06:23 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:06:23 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2076010410</nova:name>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:06:23</nova:creationTime>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:06:23 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:06:23 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:owner>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:user uuid="50b2d95238654df88548e1549fa73210">tempest-AttachVolumeNegativeTest-37766204-project-member</nova:user>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:project uuid="3743fde3d93f4fed84b52926dadc07f7">tempest-AttachVolumeNegativeTest-37766204</nova:project>
Aug 15 07:06:23 user nova-compute[72803]:       </nova:owner>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:06:23 user nova-compute[72803]:       <nova:ports>
Aug 15 07:06:23 user nova-compute[72803]:         <nova:port uuid="6609e26a-f730-45fe-b69c-f2ae2c72afc3">
Aug 15 07:06:23 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 07:06:23 user nova-compute[72803]:         </nova:port>
Aug 15 07:06:23 user nova-compute[72803]:       </nova:ports>
Aug 15 07:06:23 user nova-compute[72803]:     </nova:instance>
Aug 15 07:06:23 user nova-compute[72803]:   </metadata>
Aug 15 07:06:23 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:06:23 user nova-compute[72803]:     <system>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="serial">cfc0cd92-5f09-4726-85ec-102c2d6cefb1</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="uuid">cfc0cd92-5f09-4726-85ec-102c2d6cefb1</entry>
Aug 15 07:06:23 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:06:23 user nova-compute[72803]:     </system>
Aug 15 07:06:23 user nova-compute[72803]:   </sysinfo>
Aug 15 07:06:23 user nova-compute[72803]:   <os>
Aug 15 07:06:23 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:06:23 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:06:23 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:06:23 user nova-compute[72803]:   </os>
Aug 15 07:06:23 user nova-compute[72803]:   <features>
Aug 15 07:06:23 user nova-compute[72803]:     <acpi/>
Aug 15 07:06:23 user nova-compute[72803]:     <apic/>
Aug 15 07:06:23 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:06:23 user nova-compute[72803]:   </features>
Aug 15 07:06:23 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:06:23 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:06:23 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:06:23 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:06:23 user nova-compute[72803]:   </clock>
Aug 15 07:06:23 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:06:23 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:06:23 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:06:23 user nova-compute[72803]:   </cpu>
Aug 15 07:06:23 user nova-compute[72803]:   <devices>
Aug 15 07:06:23 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:06:23 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:06:23 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk"/>
Aug 15 07:06:23 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:06:23 user nova-compute[72803]:     </disk>
Aug 15 07:06:23 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:06:23 user nova-compute[72803]:       <mac address="fa:16:3e:96:b1:42"/>
Aug 15 07:06:23 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:06:23 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:06:23 user nova-compute[72803]:       <target dev="tap6609e26a-f7"/>
Aug 15 07:06:23 user nova-compute[72803]:     </interface>
Aug 15 07:06:23 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:06:23 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/console.log" append="off"/>
Aug 15 07:06:23 user nova-compute[72803]:     </serial>
Aug 15 07:06:23 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:06:23 user nova-compute[72803]:     <video>
Aug 15 07:06:23 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:06:23 user nova-compute[72803]:     </video>
Aug 15 07:06:23 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:06:23 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:06:23 user nova-compute[72803]:     </rng>
Aug 15 07:06:23 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:06:23 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:06:23 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:06:23 user nova-compute[72803]:     </memballoon>
Aug 15 07:06:23 user nova-compute[72803]:   </devices>
Aug 15 07:06:23 user nova-compute[72803]: </domain>
Aug 15 07:06:23 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2076010410',display_name='tempest-AttachVolumeNegativeTest-server-2076010410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2076010410',id=28,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOJTyTF0mLch0E2+pgJC+MZZhWACCUm1rDkRqfCbTKxjvf9xVmc6wNgvPaMDYkOM6452OiY5RJnWANSHJpOR1he4ydC3hLtmM+qFyB/eYW2kD6ywHFrOryORQqIsfYBrw==',key_name='tempest-keypair-467273894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-q5lzv68p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=cfc0cd92-5f09-4726-85ec-102c2d6cefb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=6609e26a-f730-45fe-b69c-f2ae2c72afc3,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6609e26a-f7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG os_vif [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=6609e26a-f730-45fe-b69c-f2ae2c72afc3,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6609e26a-f7') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6609e26a-f7, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6609e26a-f7, col_values=(('external_ids', {'iface-id': '6609e26a-f730-45fe-b69c-f2ae2c72afc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:b1:42', 'vm-uuid': 'cfc0cd92-5f09-4726-85ec-102c2d6cefb1'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:23 user nova-compute[72803]: INFO os_vif [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=6609e26a-f730-45fe-b69c-f2ae2c72afc3,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6609e26a-f7')
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:23 user nova-compute[72803]: INFO nova.compute.manager [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Detaching volume 909730d3-22b7-4511-8621-39bafd2e5359
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No VIF found with MAC fa:16:3e:96:b1:42, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:06:24 user nova-compute[72803]: INFO nova.virt.block_device [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Attempting to driver detach volume 909730d3-22b7-4511-8621-39bafd2e5359 from mountpoint /dev/vdb
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Attempting to detach device vdb from instance 5170f08d-a847-4094-82b7-749797acf8b7 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:06:24 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:06:24 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:06:24 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:06:24 user nova-compute[72803]:   <serial>909730d3-22b7-4511-8621-39bafd2e5359</serial>
Aug 15 07:06:24 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 07:06:24 user nova-compute[72803]: </disk>
Aug 15 07:06:24 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:06:24 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully detached device vdb from instance 5170f08d-a847-4094-82b7-749797acf8b7 from the persistent domain config.
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5170f08d-a847-4094-82b7-749797acf8b7 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:06:24 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:06:24 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:06:24 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:06:24 user nova-compute[72803]:   <serial>909730d3-22b7-4511-8621-39bafd2e5359</serial>
Aug 15 07:06:24 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 07:06:24 user nova-compute[72803]: </disk>
Aug 15 07:06:24 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.network.neutron [req-08fcd324-1beb-41b0-9cb2-fa0d52ae3e3a req-fc3f9914-4eba-48af-917f-28556faa4920 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Updated VIF entry in instance network info cache for port 6609e26a-f730-45fe-b69c-f2ae2c72afc3. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.network.neutron [req-08fcd324-1beb-41b0-9cb2-fa0d52ae3e3a req-fc3f9914-4eba-48af-917f-28556faa4920 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Updating instance_info_cache with network_info: [{"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-08fcd324-1beb-41b0-9cb2-fa0d52ae3e3a req-fc3f9914-4eba-48af-917f-28556faa4920 service nova] Releasing lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'flavor' on Instance uuid 59123d08-1213-4b26-865e-8a12efde9744 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5244c733-fbce-43d2-959b-48d8803def05 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.651s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.542s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:24 user nova-compute[72803]: INFO nova.compute.manager [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Terminating instance
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-0d66f716-84e8-4753-adf7-7c0b566c4c23 req-db3ed96f-4f0d-42e2-b99c-615cc8a443c6 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-unplugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0d66f716-84e8-4753-adf7-7c0b566c4c23 req-db3ed96f-4f0d-42e2-b99c-615cc8a443c6 service nova] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0d66f716-84e8-4753-adf7-7c0b566c4c23 req-db3ed96f-4f0d-42e2-b99c-615cc8a443c6 service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0d66f716-84e8-4753-adf7-7c0b566c4c23 req-db3ed96f-4f0d-42e2-b99c-615cc8a443c6 service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-0d66f716-84e8-4753-adf7-7c0b566c4c23 req-db3ed96f-4f0d-42e2-b99c-615cc8a443c6 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] No waiting events found dispatching network-vif-unplugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-0d66f716-84e8-4753-adf7-7c0b566c4c23 req-db3ed96f-4f0d-42e2-b99c-615cc8a443c6 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-unplugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:06:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083186.0022206, 5170f08d-a847-4094-82b7-749797acf8b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:06:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully detached device vdb from instance 5170f08d-a847-4094-82b7-749797acf8b7 from the live domain config.
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJTviluY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:06:26 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5995c9-06ff-4782-a441-18046eb290b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb622c4-cdfa-4326-b539-3025f94f6196]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:26 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:06:26 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:26 user nova-compute[72803]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 (non-flash)
Aug 15 07:06:26 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c078d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee37638e-26c1-46f8-bad6-7de7080c1515]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[84341969-990f-4c5f-a1da-529bbf25ae2e]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e46639e-531e-44fb-9f82-3958b72fe1f0]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba479ab-1861-4869-adaa-77436da9c571]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[88582343-3923-4adc-84c7-7e6956ab33c6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[32efcc61-aa15-493e-a011-3e313269474d]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260]
Aug 15 07:06:26 user nova-compute[72803]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359, portal: 172.16.0.220,3260] successful.
Aug 15 07:06:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909730d3-22b7-4511-8621-39bafd2e5359 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bc6269-ba1e-44c4-ade0-85d485d7d601]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== disconnect_volume: return (357ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:06:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Instance destroyed successfully.
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.objects.instance [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'resources' on Instance uuid 59123d08-1213-4b26-865e-8a12efde9744 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-736575719',display_name='tempest-VolumesSnapshotTestJSON-instance-736575719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-736575719',id=25,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeJLaHK92HXJJFMCSV+D3kKEP3kQBRMGMhoBd3/gDUTJVtNl2V6B6IrjUvsejsBLdT+lziTkqLbCmWcHrSFE0672gpHlCDKxv0w4nAU466C2TpuEdjDMHqobvaYthOfDA==',key_name='tempest-keypair-1189402010',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415992ab9c124f2db890795802e64ed3',ramdisk_id='',reservation_id='r-1qdp1k7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1700542254',owner_user_name='tempest-VolumesSnapshotTestJSON-1700542254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c445be5492b44a4ac0ab0ffb9bf6b61',uuid=59123d08-1213-4b26-865e-8a12efde9744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converting VIF {"id": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "address": "fa:16:3e:02:0f:13", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2c94f6-af", "ovs_interfaceid": "0b2c94f6-afae-4e9d-b856-c8f2c9efe1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:0f:13,bridge_name='br-int',has_traffic_filtering=True,id=0b2c94f6-afae-4e9d-b856-c8f2c9efe1db,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2c94f6-af') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_vif [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:0f:13,bridge_name='br-int',has_traffic_filtering=True,id=0b2c94f6-afae-4e9d-b856-c8f2c9efe1db,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2c94f6-af') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b2c94f6-af, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: INFO os_vif [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:0f:13,bridge_name='br-int',has_traffic_filtering=True,id=0b2c94f6-afae-4e9d-b856-c8f2c9efe1db,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2c94f6-af')
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qeLQszEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:06:26 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f63db7-8dd3-4cae-a725-85e3fca9ebb4', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b8d05e-f58b-44e4-ba7f-a22e60048795]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[86797962-c4c3-420b-a11d-6bf50cb8382c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:26 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:26 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c07da830>, {}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Disconnecting from: [] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] <== disconnect_volume: return (54ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:06:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Deleting instance files /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744_del
Aug 15 07:06:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Deletion of /opt/stack/data/nova/instances/59123d08-1213-4b26-865e-8a12efde9744_del complete
Aug 15 07:06:26 user nova-compute[72803]: INFO nova.compute.manager [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Took 2.08 seconds to destroy the instance on the hypervisor.
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 59123d08-1213-4b26-865e-8a12efde9744] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-e80d523c-5b82-4eba-bd9d-4d48900a0ab5 req-a3415065-1997-457d-80fd-0ea075f821fb service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e80d523c-5b82-4eba-bd9d-4d48900a0ab5 req-a3415065-1997-457d-80fd-0ea075f821fb service nova] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e80d523c-5b82-4eba-bd9d-4d48900a0ab5 req-a3415065-1997-457d-80fd-0ea075f821fb service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e80d523c-5b82-4eba-bd9d-4d48900a0ab5 req-a3415065-1997-457d-80fd-0ea075f821fb service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-e80d523c-5b82-4eba-bd9d-4d48900a0ab5 req-a3415065-1997-457d-80fd-0ea075f821fb service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] No waiting events found dispatching network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:26 user nova-compute[72803]: WARNING nova.compute.manager [req-e80d523c-5b82-4eba-bd9d-4d48900a0ab5 req-a3415065-1997-457d-80fd-0ea075f821fb service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received unexpected event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 07:06:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] No waiting events found dispatching network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:27 user nova-compute[72803]: WARNING nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received unexpected event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db for instance with vm_state active and task_state deleting.
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] No waiting events found dispatching network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:27 user nova-compute[72803]: WARNING nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received unexpected event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db for instance with vm_state active and task_state deleting.
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] No waiting events found dispatching network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:27 user nova-compute[72803]: WARNING nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received unexpected event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db for instance with vm_state active and task_state deleting.
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-unplugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] No waiting events found dispatching network-vif-unplugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-unplugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Acquiring lock "59123d08-1213-4b26-865e-8a12efde9744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] Lock "59123d08-1213-4b26-865e-8a12efde9744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] No waiting events found dispatching network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:27 user nova-compute[72803]: WARNING nova.compute.manager [req-5cc0ca19-67bf-403a-abea-1ecab85f3ef4 req-88e4136d-1aff-4ec6-8be9-bc5447d8c7ca service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received unexpected event network-vif-plugged-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db for instance with vm_state active and task_state deleting.
Aug 15 07:06:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c20e3f31-b792-48f4-b312-05ffcd60befd tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.506s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-784e3c5f-4a07-4355-8345-f951deb67631 req-e1fa2523-27b0-4fae-8da4-02f3b7727186 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Received event network-vif-deleted-0b2c94f6-afae-4e9d-b856-c8f2c9efe1db {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:27 user nova-compute[72803]: INFO nova.compute.manager [req-784e3c5f-4a07-4355-8345-f951deb67631 req-e1fa2523-27b0-4fae-8da4-02f3b7727186 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Neutron deleted interface 0b2c94f6-afae-4e9d-b856-c8f2c9efe1db; detaching it from the instance and deleting it from the info cache
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.network.neutron [req-784e3c5f-4a07-4355-8345-f951deb67631 req-e1fa2523-27b0-4fae-8da4-02f3b7727186 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:27 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Took 1.07 seconds to deallocate network for instance.
Aug 15 07:06:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-784e3c5f-4a07-4355-8345-f951deb67631 req-e1fa2523-27b0-4fae-8da4-02f3b7727186 service nova] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Detach interface failed, port_id=0b2c94f6-afae-4e9d-b856-c8f2c9efe1db, reason: Instance 59123d08-1213-4b26-865e-8a12efde9744 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:06:27 user nova-compute[72803]: WARNING nova.volume.cinder [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Attachment 3db965ba-2c3d-435b-b4ab-5ba2837614cb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3db965ba-2c3d-435b-b4ab-5ba2837614cb. (HTTP 404) (Request-ID: req-4d44522b-6a23-4929-b1c8-ff763812f834)
Aug 15 07:06:27 user nova-compute[72803]: INFO nova.compute.manager [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Took 0.07 seconds to detach 1 volumes for instance.
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:28 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Deleted allocations for instance 59123d08-1213-4b26-865e-8a12efde9744
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-42348836-6eb8-4ee2-a2e9-02e9da7116e2 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "59123d08-1213-4b26-865e-8a12efde9744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.847s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5b3f1f67-d0f7-476f-912a-b6cb405b2783 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5b3f1f67-d0f7-476f-912a-b6cb405b2783 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5b3f1f67-d0f7-476f-912a-b6cb405b2783 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5b3f1f67-d0f7-476f-912a-b6cb405b2783 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72803) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5b3f1f67-d0f7-476f-912a-b6cb405b2783 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] No waiting events found dispatching network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:28 user nova-compute[72803]: WARNING nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received unexpected event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received event network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] No waiting events found dispatching network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:28 user nova-compute[72803]: WARNING nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received unexpected event network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 for instance with vm_state building and task_state spawning.
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received event network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] No waiting events found dispatching network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:28 user nova-compute[72803]: WARNING nova.compute.manager [req-cc59f25c-5c26-4088-98ae-8221ab37e3f2 req-1f528d06-448d-4c7c-9c41-afc1ed5219e8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received unexpected event network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 for instance with vm_state building and task_state spawning.
Aug 15 07:06:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance destroyed successfully.
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5b3f1f67-d0f7-476f-912a-b6cb405b2783 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5b3f1f67-d0f7-476f-912a-b6cb405b2783 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.929s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083189.4402425, cfc0cd92-5f09-4726-85ec-102c2d6cefb1 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] VM Resumed (Lifecycle Event)
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Instance spawned successfully.
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083189.4447696, cfc0cd92-5f09-4726-85ec-102c2d6cefb1 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] VM Started (Lifecycle Event)
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Took 7.94 seconds to spawn the instance on the hypervisor.
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083189.597141, 506ed7b9-6081-418b-86a8-278db430893e => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] VM Resumed (Lifecycle Event)
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance spawned successfully.
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083189.5974717, 506ed7b9-6081-418b-86a8-278db430893e => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] VM Started (Lifecycle Event)
Aug 15 07:06:29 user nova-compute[72803]: INFO nova.compute.manager [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Took 8.83 seconds to build instance.
Aug 15 07:06:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f698e632-2610-4843-9e04-76cbab500334 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.779s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90687dca-b269-40e8-8d79-fdaf6ab3e71b tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.928s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:30 user nova-compute[72803]: WARNING nova.compute.manager [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state stopped and task_state None.
Aug 15 07:06:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:06:30 user nova-compute[72803]: WARNING nova.compute.manager [req-97b75bbe-6548-4a54-a6bd-3a2ef2048758 req-39c4315f-9769-420d-a6ff-514255f58e88 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state stopped and task_state None.
Aug 15 07:06:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:32 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:06:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:06:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:06:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:37 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:06:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:06:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:06:37 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updating instance_info_cache with network_info: [{"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:06:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:06:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083186.367048, 59123d08-1213-4b26-865e-8a12efde9744 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:06:41 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 59123d08-1213-4b26-865e-8a12efde9744] VM Stopped (Lifecycle Event)
Aug 15 07:06:41 user nova-compute[72803]: DEBUG nova.compute.manager [None req-df679eb0-b465-4360-9929-38d489dc2bca None None] [instance: 59123d08-1213-4b26-865e-8a12efde9744] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:41 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:06:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083189.3178062, 5170f08d-a847-4094-82b7-749797acf8b7 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:06:44 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Stopped (Lifecycle Event)
Aug 15 07:06:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8b1a8e8a-17a1-4593-a267-1cf1f41694c1 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8b1a8e8a-17a1-4593-a267-1cf1f41694c1 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:45 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:06:45 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=25.39633560180664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.objects.instance [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'flavor' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 506ed7b9-6081-418b-86a8-278db430893e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:45 user nova-compute[72803]: INFO nova.compute.manager [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Attaching volume b3b23c9e-adc1-4800-bf40-740385364765 to /dev/vdb
Aug 15 07:06:45 user nova-compute[72803]: DEBUG os_brick.utils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c39006-ab9c-48d5-b331-7048762272c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b715c-fda9-4fa8-91aa-8e5c731b7285]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec90b711-572b-4f0e-a22f-6c916ff44477]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee6334-1f2a-4a17-bbad-3aaa03205ff8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:06:45 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdde938-6a3e-448c-9bc8-75c583f636fe]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG os_brick.utils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating existing volume attachment record: 5c2fc56a-9f63-452f-b030-cb37e414b8db {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.779s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:06:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-8bce3045-fdc1-40fd-acfe-b99718937118 req-518a3fc6-320e-4f2a-a469-22318dc3ebce service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received event network-changed-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-8bce3045-fdc1-40fd-acfe-b99718937118 req-518a3fc6-320e-4f2a-a469-22318dc3ebce service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Refreshing instance network info cache due to event network-changed-e478da74-bdfe-4812-b471-86d1252ee7e9. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:06:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8bce3045-fdc1-40fd-acfe-b99718937118 req-518a3fc6-320e-4f2a-a469-22318dc3ebce service nova] Acquiring lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8bce3045-fdc1-40fd-acfe-b99718937118 req-518a3fc6-320e-4f2a-a469-22318dc3ebce service nova] Acquired lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:50 user nova-compute[72803]: DEBUG nova.network.neutron [req-8bce3045-fdc1-40fd-acfe-b99718937118 req-518a3fc6-320e-4f2a-a469-22318dc3ebce service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Refreshing network info cache for port e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG nova.network.neutron [req-8bce3045-fdc1-40fd-acfe-b99718937118 req-518a3fc6-320e-4f2a-a469-22318dc3ebce service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updated VIF entry in instance network info cache for port e478da74-bdfe-4812-b471-86d1252ee7e9. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG nova.network.neutron [req-8bce3045-fdc1-40fd-acfe-b99718937118 req-518a3fc6-320e-4f2a-a469-22318dc3ebce service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updating instance_info_cache with network_info: [{"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8bce3045-fdc1-40fd-acfe-b99718937118 req-518a3fc6-320e-4f2a-a469-22318dc3ebce service nova] Releasing lock "refresh_cache-9c7018fa-ebd1-4446-a8ca-f775ee3a570d" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'flavor' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:51 user nova-compute[72803]: INFO nova.compute.manager [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Attaching volume 0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f to /dev/vdb
Aug 15 07:06:51 user nova-compute[72803]: DEBUG os_brick.utils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bdaf4d-d40b-42f8-8034-249da4fce3e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e61882b-2230-43ad-9b1c-278cb6bd50ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09e8bdc-80f9-4ed4-bc0a-129bb587fa80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[540297da-a89e-4265-ab99-89238dccf233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:06:51 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:06:51 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[185b2bfe-a026-4248-8664-19631174b5fb]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG os_brick.utils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:06:51 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updating existing volume attachment record: cd512786-0729-4da1-9fa3-036d86ac37b1 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:06:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:06:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:54 user nova-compute[72803]: INFO nova.compute.manager [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Unshelving
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:06:55 user nova-compute[72803]: INFO nova.compute.claims [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Claim successful on node user
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.493s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:06:55 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:06:55 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:06:55 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'pci_requests' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'numa_topology' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaabe3c-ef5a-4c3d-8481-d87f03effb31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:06:55 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:06:55 user nova-compute[72803]: INFO nova.compute.claims [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Claim successful on node user
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7d23e1-08b6-4056-82da-fa6a266e8eaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765] added
Aug 15 07:06:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c3bc4d-0bef-46ce-950b-da529185bebc]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a291b1c-b18e-451f-99ca-88ae23f04108]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmoIOEMV {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmoIOEMV" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[16353a21-6325-414f-8273-cd40a2f26312]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmoIOEMV'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: INFO nova.virt.block_device [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Booting with volume-backed-image 058dab3c-04e2-4357-a904-efeb3f5412a5 at /dev/vda
Aug 15 07:06:55 user nova-compute[72803]: DEBUG nova.policy [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc7ee5090ba54d4b8acbd4c9f84835f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ede5bd5cb24059bc4a185badef865d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8073db9-e983-46bb-993f-eaaa6d1b8cd3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[790cc9d8-93f5-4e10-937f-8902dda2780c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:55 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:55 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e94cfb6-db6f-4435-bab1-aace94534b48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]
Aug 15 07:06:55 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.
Aug 15 07:06:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65ca701-aa4d-413a-a54a-71b4dccfa50b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a9628-b49d-4a89-ae1e-b5308f4d4626]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:55 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:55 user nova-compute[72803]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:06:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:06:55 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:06:55 user nova-compute[72803]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:06:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[221efe91-102e-4bb2-afa5-38706658454f]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:06:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:56 user nova-compute[72803]: INFO nova.network.neutron [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updating port 390036c0-19a4-46bf-9e26-a90cdb1e2333 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Successfully created port: 7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23566396432616361', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566396432616361', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:06:56 user nova-compute[72803]: DEBUG nova.objects.instance [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'flavor' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:06:57 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:06:57 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:06:57 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:06:57 user nova-compute[72803]:   <serial>b3b23c9e-adc1-4800-bf40-740385364765</serial>
Aug 15 07:06:57 user nova-compute[72803]: </disk>
Aug 15 07:06:57 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquired lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-d8c4706b-ae9f-4363-9392-a165cb553422 req-7e4090a7-5017-4bd9-b6b7-ab108a2eca8d service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-changed-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-d8c4706b-ae9f-4363-9392-a165cb553422 req-7e4090a7-5017-4bd9-b6b7-ab108a2eca8d service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Refreshing instance network info cache due to event network-changed-390036c0-19a4-46bf-9e26-a90cdb1e2333. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d8c4706b-ae9f-4363-9392-a165cb553422 req-7e4090a7-5017-4bd9-b6b7-ab108a2eca8d service nova] Acquiring lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Successfully updated port: 7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquired lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-e4bc0030-9a8f-4a4e-9198-0bf39fe3ca56 req-66e12be5-a619-4cd0-8ca1-415506a78b95 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-changed-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-e4bc0030-9a8f-4a4e-9198-0bf39fe3ca56 req-66e12be5-a619-4cd0-8ca1-415506a78b95 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Refreshing instance network info cache due to event network-changed-7f5ebbd1-04cb-44df-a1a0-fe9979075501. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e4bc0030-9a8f-4a4e-9198-0bf39fe3ca56 req-66e12be5-a619-4cd0-8ca1-415506a78b95 service nova] Acquiring lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] No VIF found with MAC fa:16:3e:32:4e:18, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96915cde-e711-4b92-a866-1db9b4d59418 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.156s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updating instance_info_cache with network_info: [{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Releasing lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:06:57 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Creating image(s)
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'trusted_certs' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d8c4706b-ae9f-4363-9392-a165cb553422 req-7e4090a7-5017-4bd9-b6b7-ab108a2eca8d service nova] Acquired lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-d8c4706b-ae9f-4363-9392-a165cb553422 req-7e4090a7-5017-4bd9-b6b7-ab108a2eca8d service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Refreshing network info cache for port 390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "e044bd732842926a22611a54fff3bea7bf401cc1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "e044bd732842926a22611a54fff3bea7bf401cc1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Updating instance_info_cache with network_info: [{"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Releasing lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance network_info: |[{"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:06:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e4bc0030-9a8f-4a4e-9198-0bf39fe3ca56 req-66e12be5-a619-4cd0-8ca1-415506a78b95 service nova] Acquired lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:06:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-e4bc0030-9a8f-4a4e-9198-0bf39fe3ca56 req-66e12be5-a619-4cd0-8ca1-415506a78b95 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Refreshing network info cache for port 7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1.part --force-share --output=json" returned: 0 in 0.232s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG nova.virt.images [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] 137fd1c2-9b86-41f3-bd50-ca65e1a97899 was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1.part /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1.part /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1.converted" returned: 0 in 0.382s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "e044bd732842926a22611a54fff3bea7bf401cc1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.788s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-d8c4706b-ae9f-4363-9392-a165cb553422 req-7e4090a7-5017-4bd9-b6b7-ab108a2eca8d service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updated VIF entry in instance network info cache for port 390036c0-19a4-46bf-9e26-a90cdb1e2333. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-d8c4706b-ae9f-4363-9392-a165cb553422 req-7e4090a7-5017-4bd9-b6b7-ab108a2eca8d service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updating instance_info_cache with network_info: [{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d8c4706b-ae9f-4363-9392-a165cb553422 req-7e4090a7-5017-4bd9-b6b7-ab108a2eca8d service nova] Releasing lock "refresh_cache-56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1 --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "e044bd732842926a22611a54fff3bea7bf401cc1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "e044bd732842926a22611a54fff3bea7bf401cc1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-e4bc0030-9a8f-4a4e-9198-0bf39fe3ca56 req-66e12be5-a619-4cd0-8ca1-415506a78b95 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Updated VIF entry in instance network info cache for port 7f5ebbd1-04cb-44df-a1a0-fe9979075501. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-e4bc0030-9a8f-4a4e-9198-0bf39fe3ca56 req-66e12be5-a619-4cd0-8ca1-415506a78b95 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Updating instance_info_cache with network_info: [{"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:06:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e4bc0030-9a8f-4a4e-9198-0bf39fe3ca56 req-66e12be5-a619-4cd0-8ca1-415506a78b95 service nova] Releasing lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1 --force-share --output=json" returned: 0 in 0.216s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1,backing_fmt=raw /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1,backing_fmt=raw /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk 1073741824" returned: 0 in 0.084s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "e044bd732842926a22611a54fff3bea7bf401cc1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1 --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'migration_context' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Rebasing disk image.
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.211s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 -F raw /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Stashing vm_state: active {{(pid=72803) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'pci_requests' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:07:00 user nova-compute[72803]: INFO nova.compute.claims [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Claim successful on node user
Aug 15 07:07:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'resources' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'pci_devices' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:01 user nova-compute[72803]: INFO nova.compute.resource_tracker [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating resource usage from migration 486cc2fb-4672-45ba-aa57-40b6786f152b
Aug 15 07:07:01 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:07:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:01 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:07:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.100s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:01 user nova-compute[72803]: INFO nova.compute.manager [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Migrating
Aug 15 07:07:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:07:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:07:01 user nova-compute[72803]: INFO nova.compute.rpcapi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 07:07:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquired lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXHecYEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:02 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:02 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:02 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8863c39a-f800-401d-876b-42927dcd97e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:07:02 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f35c7b-5dfe-444f-b862-833982fca81a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f] added
Aug 15 07:07:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f7b5b-d513-4ec8-858f-23bb3e39e763]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6225b56-6d6a-44f8-b758-f852e7b12144]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXHecYEv {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXHecYEv" returned: 0 in 0.036s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3bdfdb-a833-41b4-9e89-4e2890962b81]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IXHecYEv'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c7c0d-cf2a-4a6c-85da-15e304083880]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c982ef00-1914-495f-ae50-94ef421d9604]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:02 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:02 user nova-compute[72803]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:02 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:02 user nova-compute[72803]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4e932b-c816-4cf9-b63c-b2d9f2ade426]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f, portal: 172.16.0.220,3260]
Aug 15 07:07:02 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f, portal: 172.16.0.220,3260] successful.
Aug 15 07:07:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e069c20-7eac-4272-964c-3a06f0632d26]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e7acef-7638-462c-abeb-19049cbfa790]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:03 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:03 user nova-compute[72803]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:03 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:03 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:03 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:03 user nova-compute[72803]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:03 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:03 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Releasing lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f063d-ad05-4c84-be5c-b1ca0dcd9c30]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXHecYEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Starting migrate_disk_and_power_off {{(pid=72803) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 -F raw /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk" returned: 0 in 2.897s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Ensure instance console log exists: /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Start _get_guest_xml network_info=[{"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6a64dccf923884eb9a1626da692a4353',container_format='bare',created_at=2023-08-15T07:05:02Z,direct_url=<?>,disk_format='qcow2',id=137fd1c2-9b86-41f3-bd50-ca65e1a97899,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1958541110-shelved',owner='f7937188c3cb441fa4f4348d2e3b2573',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T07:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:07:03 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:03 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6a64dccf923884eb9a1626da692a4353',container_format='bare',created_at=2023-08-15T07:05:02Z,direct_url=<?>,disk_format='qcow2',id=137fd1c2-9b86-41f3-bd50-ca65e1a97899,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1958541110-shelved',owner='f7937188c3cb441fa4f4348d2e3b2573',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T07:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1958541110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1958541110',id=23,image_ref='137fd1c2-9b86-41f3-bd50-ca65e1a97899',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-312287039',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-nt0tdef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member',shelved_at='2023-08-15T07:05:05.928113',shelved_host='user',shelved_image_id='137fd1c2-9b86-41f3-bd50-ca65e1a97899'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=56b3f17c-680b-4cbc-ad5a-26ec9f4ee154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'pci_devices' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:07:03 user nova-compute[72803]:   <uuid>56b3f17c-680b-4cbc-ad5a-26ec9f4ee154</uuid>
Aug 15 07:07:03 user nova-compute[72803]:   <name>instance-00000017</name>
Aug 15 07:07:03 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:07:03 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:07:03 user nova-compute[72803]:   <metadata>
Aug 15 07:07:03 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:07:03 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:07:03 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1958541110</nova:name>
Aug 15 07:07:03 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:07:03</nova:creationTime>
Aug 15 07:07:03 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:07:03 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:07:03 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:07:03 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:07:03 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:07:03 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:07:03 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:07:03 user nova-compute[72803]:       <nova:owner>
Aug 15 07:07:03 user nova-compute[72803]:         <nova:user uuid="35a29bfde8d746f9b15c12e31a925c47">tempest-AttachVolumeShelveTestJSON-758519316-project-member</nova:user>
Aug 15 07:07:03 user nova-compute[72803]:         <nova:project uuid="f7937188c3cb441fa4f4348d2e3b2573">tempest-AttachVolumeShelveTestJSON-758519316</nova:project>
Aug 15 07:07:03 user nova-compute[72803]:       </nova:owner>
Aug 15 07:07:03 user nova-compute[72803]:       <nova:root type="image" uuid="137fd1c2-9b86-41f3-bd50-ca65e1a97899"/>
Aug 15 07:07:03 user nova-compute[72803]:       <nova:ports>
Aug 15 07:07:03 user nova-compute[72803]:         <nova:port uuid="390036c0-19a4-46bf-9e26-a90cdb1e2333">
Aug 15 07:07:03 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:07:03 user nova-compute[72803]:         </nova:port>
Aug 15 07:07:03 user nova-compute[72803]:       </nova:ports>
Aug 15 07:07:03 user nova-compute[72803]:     </nova:instance>
Aug 15 07:07:03 user nova-compute[72803]:   </metadata>
Aug 15 07:07:03 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:07:03 user nova-compute[72803]:     <system>
Aug 15 07:07:03 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:07:03 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:07:03 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:07:03 user nova-compute[72803]:       <entry name="serial">56b3f17c-680b-4cbc-ad5a-26ec9f4ee154</entry>
Aug 15 07:07:03 user nova-compute[72803]:       <entry name="uuid">56b3f17c-680b-4cbc-ad5a-26ec9f4ee154</entry>
Aug 15 07:07:03 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:07:03 user nova-compute[72803]:     </system>
Aug 15 07:07:03 user nova-compute[72803]:   </sysinfo>
Aug 15 07:07:03 user nova-compute[72803]:   <os>
Aug 15 07:07:03 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:07:03 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:07:03 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:07:03 user nova-compute[72803]:   </os>
Aug 15 07:07:03 user nova-compute[72803]:   <features>
Aug 15 07:07:03 user nova-compute[72803]:     <acpi/>
Aug 15 07:07:03 user nova-compute[72803]:     <apic/>
Aug 15 07:07:03 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:07:03 user nova-compute[72803]:   </features>
Aug 15 07:07:03 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:07:03 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:07:03 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:07:03 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:07:03 user nova-compute[72803]:   </clock>
Aug 15 07:07:03 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:07:03 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:07:03 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:07:03 user nova-compute[72803]:   </cpu>
Aug 15 07:07:03 user nova-compute[72803]:   <devices>
Aug 15 07:07:03 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:07:03 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:07:03 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk"/>
Aug 15 07:07:03 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:07:03 user nova-compute[72803]:     </disk>
Aug 15 07:07:03 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:07:03 user nova-compute[72803]:       <mac address="fa:16:3e:ae:4f:86"/>
Aug 15 07:07:03 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:03 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:07:03 user nova-compute[72803]:       <target dev="tap390036c0-19"/>
Aug 15 07:07:03 user nova-compute[72803]:     </interface>
Aug 15 07:07:03 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:07:03 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/console.log" append="off"/>
Aug 15 07:07:03 user nova-compute[72803]:     </serial>
Aug 15 07:07:03 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:07:03 user nova-compute[72803]:     <video>
Aug 15 07:07:03 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:03 user nova-compute[72803]:     </video>
Aug 15 07:07:03 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:07:03 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:07:03 user nova-compute[72803]:     </rng>
Aug 15 07:07:03 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:07:03 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:07:03 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:07:03 user nova-compute[72803]:     </memballoon>
Aug 15 07:07:03 user nova-compute[72803]:   </devices>
Aug 15 07:07:03 user nova-compute[72803]: </domain>
Aug 15 07:07:03 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1958541110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1958541110',id=23,image_ref='137fd1c2-9b86-41f3-bd50-ca65e1a97899',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-312287039',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-nt0tdef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member',shelved_at='2023-08-15T07:05:05.928113',shelved_host='user',shelved_image_id='137fd1c2-9b86-41f3-bd50-ca65e1a97899'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=56b3f17c-680b-4cbc-ad5a-26ec9f4ee154,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG os_vif [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap390036c0-19, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap390036c0-19, col_values=(('external_ids', {'iface-id': '390036c0-19a4-46bf-9e26-a90cdb1e2333', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:4f:86', 'vm-uuid': '56b3f17c-680b-4cbc-ad5a-26ec9f4ee154'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-bdec7074-b15d-45ba-88b4-50b221553c7b req-0121946b-961a-4397-ad59-01472cf4ddd3 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bdec7074-b15d-45ba-88b4-50b221553c7b req-0121946b-961a-4397-ad59-01472cf4ddd3 service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bdec7074-b15d-45ba-88b4-50b221553c7b req-0121946b-961a-4397-ad59-01472cf4ddd3 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bdec7074-b15d-45ba-88b4-50b221553c7b req-0121946b-961a-4397-ad59-01472cf4ddd3 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-bdec7074-b15d-45ba-88b4-50b221553c7b req-0121946b-961a-4397-ad59-01472cf4ddd3 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:03 user nova-compute[72803]: WARNING nova.compute.manager [req-bdec7074-b15d-45ba-88b4-50b221553c7b req-0121946b-961a-4397-ad59-01472cf4ddd3 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state resize_migrating.
Aug 15 07:07:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:03 user nova-compute[72803]: INFO os_vif [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19')
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] No VIF found with MAC fa:16:3e:ae:4f:86, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23164646563663934', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164646563663934', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'flavor' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:07:04 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:07:04 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:07:04 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:07:04 user nova-compute[72803]:   <serial>0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f</serial>
Aug 15 07:07:04 user nova-compute[72803]: </disk>
Aug 15 07:07:04 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance destroyed successfully.
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1617322884-network", "vif_mac": "fa:16:3e:32:4e:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1617322884-network", "vif_mac": "fa:16:3e:32:4e:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_vif [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89d1c280-da, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: INFO os_vif [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da')
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:04 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ed42f-121f-4823-b7c7-fb8a2dcd6edc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae8614a-8893-4876-a0d6-265756edc0c1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:04 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:04 user nova-compute[72803]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:04 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:04 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:04 user nova-compute[72803]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:04 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e02dbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[580b47f6-14d6-4b7f-9674-510e7a9b7b8c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a6fa8e-94d1-4f83-beff-0aeb8b8cf333]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca40330-92af-4ad9-b043-9926b54b4f4e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae1001d-d9ca-4faf-8e6d-09b5c851f9b8]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c54d9cf-10a4-40b3-ad62-9e67d436ca7e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f38a1-8aae-4479-91ad-4f776d605706]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]
Aug 15 07:07:04 user nova-compute[72803]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.
Aug 15 07:07:04 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b9d6af-2000-4b89-a410-4cdfcfc40d51]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== disconnect_volume: return (323ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No VIF found with MAC fa:16:3e:ee:2c:d1, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfe9e0a9-1617-46cc-b8e9-7a05827afa7b tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.372s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03_resize/disk /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:05 user nova-compute[72803]: WARNING nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state resize_migrating.
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:05 user nova-compute[72803]: WARNING nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state resize_migrating.
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:05 user nova-compute[72803]: WARNING nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state resize_migrating.
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:05 user nova-compute[72803]: WARNING nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state resize_migrating.
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:05 user nova-compute[72803]: WARNING nova.compute.manager [req-4a5cd042-1bc2-4960-ac99-67f36e57812e req-c2a16eea-da2b-4db8-8979-9fe2c660ea3d service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state resize_migrating.
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "cp -r /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03_resize/disk /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk" returned: 0 in 0.409s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03_resize/disk.info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk.info {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "cp -r /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03_resize/disk.info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk.info" returned: 0 in 0.075s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG os_brick.utils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29dba7a-46a0-4867-a2bb-236e8c8aab16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde4b978-7359-407f-b67c-bd3c494ef0ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d739cbc-98e7-4133-8419-3ca6a8318838]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e2c3d-c66c-40ed-8e1e-da819c70c097]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:07:06 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:07:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0412b6-0e10-454b-aa93-345820ced27e]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG os_brick.utils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:06 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Updating existing volume attachment record: accff008-8294-46e2-9810-70acf15c4c96 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Port 89d1c280-dac6-41fa-8fb1-0d1b31c21f10 binding to destination host user is already ACTIVE {{(pid=72803) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquired lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] No waiting events found dispatching network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:07 user nova-compute[72803]: WARNING nova.compute.manager [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received unexpected event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 07:07:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] No waiting events found dispatching network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:07 user nova-compute[72803]: WARNING nova.compute.manager [req-09d3405b-313a-48f3-93e2-bad53e570e96 req-bc0baedc-a1a8-4c5a-b60f-1d0aa7135e3f service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received unexpected event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Releasing lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG os_brick.utils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e70c943-6822-4d8e-91be-b8356f2bc02a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f08247e-261a-4f90-91bc-837ba3e23d4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7709ba28-b8d4-40b5-a628-e7fd230589a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c963834f-4127-4ac8-a944-87333bd62958]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:07:08 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:07:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e81f34c-3f1b-45c9-8de1-3cacee69c2c6]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG os_brick.utils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083228.5787427, 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:08 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] VM Resumed (Lifecycle Event)
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:07:08 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance spawned successfully.
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:08 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083228.588246, 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:08 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] VM Started (Lifecycle Event)
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:08 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:07:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cfacb6a0-7ddd-47d7-8260-d457b13c2c23 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.220s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'flavor' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:10 user nova-compute[72803]: INFO nova.compute.manager [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Attaching volume 722d6f0c-ed79-4806-91c8-d84b573295b5 to /dev/vdc
Aug 15 07:07:10 user nova-compute[72803]: DEBUG os_brick.utils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7756d882-3f35-4087-9292-e8e279bdb716]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3ccdb2-d20f-4be8-947e-c7156804e4ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba74f85-8cd9-4367-b41f-2bac8b22ad50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35aeb05-66f4-4696-86cc-21c92ff60414]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:07:10 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:07:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2df229-e2c1-418a-9235-9f15b4bfe1e7]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG os_brick.utils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:10 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updating existing volume attachment record: 4654a188-b07f-4ef0-9a53-608beb7c6ddd {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:07:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:07:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Creating image(s)
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Ensure instance console log exists: /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Start _get_guest_xml network_info=[{"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'accff008-8294-46e2-9810-70acf15c4c96', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQoitgBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '549d5d40-8521-4a9b-abbd-f6319b5b393b', 'attached_at': '', 'detached_at': '', 'volume_id': '65a376f5-1916-4ba2-a54e-da440b48eb1b', 'serial': '65a376f5-1916-4ba2-a54e-da440b48eb1b'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:07:18 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:18 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQoitgBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:18 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:18 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:18 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a36aadb-d0c4-4626-ac4b-bc4f8404a8e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:07:18 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2e71f-6ee9-4b48-a085-c906585db985]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b] added
Aug 15 07:07:18 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a21b715-e614-4469-b7c4-252ecab89900]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb2220f-abf0-46aa-8ed8-c443b6a0a6c3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQoitgBV {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQoitgBV" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc7245-d4db-4322-badd-e68da1d133d9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQoitgBV'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05aa67e-f123-46f3-a981-cccd188dfa1d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b29a77-b036-4505-80fd-1131aaeda725]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:18 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:18 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce0324-5962-487d-9359-c4b73ed2886b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b, portal: 172.16.0.220,3260]
Aug 15 07:07:18 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b, portal: 172.16.0.220,3260] successful.
Aug 15 07:07:18 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b16c805-b883-4bc8-95f5-f0510059aa02]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97d6d86-4fce-47fa-bbf7-c0059c527be4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:18 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:18 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:18 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fccb38b-1580-4219-a813-5539ffe20d18]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:07:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQoitgBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083224.4138052, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:19 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Stopped (Lifecycle Event)
Aug 15 07:07:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1ca1aac8-70c6-4fe1-986a-8691e6cd3984 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1ca1aac8-70c6-4fe1-986a-8691e6cd3984 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:19 user nova-compute[72803]: INFO nova.compute.manager [None req-1ca1aac8-70c6-4fe1-986a-8691e6cd3984 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 07:07:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26637393166633633', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637393166633633', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322158826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322158826',id=29,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-n98lymqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:06:56Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=549d5d40-8521-4a9b-abbd-f6319b5b393b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:41:07,bridge_name='br-int',has_traffic_filtering=True,id=7f5ebbd1-04cb-44df-a1a0-fe9979075501,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5ebbd1-04') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'pci_devices' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:07:20 user nova-compute[72803]:   <uuid>549d5d40-8521-4a9b-abbd-f6319b5b393b</uuid>
Aug 15 07:07:20 user nova-compute[72803]:   <name>instance-0000001d</name>
Aug 15 07:07:20 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:07:20 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:07:20 user nova-compute[72803]:   <metadata>
Aug 15 07:07:20 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:07:20 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:07:20 user nova-compute[72803]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1322158826</nova:name>
Aug 15 07:07:20 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:07:18</nova:creationTime>
Aug 15 07:07:20 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:07:20 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:07:20 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:07:20 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:07:20 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:07:20 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:07:20 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:07:20 user nova-compute[72803]:       <nova:owner>
Aug 15 07:07:20 user nova-compute[72803]:         <nova:user uuid="bc7ee5090ba54d4b8acbd4c9f84835f3">tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member</nova:user>
Aug 15 07:07:20 user nova-compute[72803]:         <nova:project uuid="07ede5bd5cb24059bc4a185badef865d">tempest-ServerBootFromVolumeStableRescueTest-1860507335</nova:project>
Aug 15 07:07:20 user nova-compute[72803]:       </nova:owner>
Aug 15 07:07:20 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:07:20 user nova-compute[72803]:       <nova:ports>
Aug 15 07:07:20 user nova-compute[72803]:         <nova:port uuid="7f5ebbd1-04cb-44df-a1a0-fe9979075501">
Aug 15 07:07:20 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 07:07:20 user nova-compute[72803]:         </nova:port>
Aug 15 07:07:20 user nova-compute[72803]:       </nova:ports>
Aug 15 07:07:20 user nova-compute[72803]:     </nova:instance>
Aug 15 07:07:20 user nova-compute[72803]:   </metadata>
Aug 15 07:07:20 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:07:20 user nova-compute[72803]:     <system>
Aug 15 07:07:20 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:07:20 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:07:20 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:07:20 user nova-compute[72803]:       <entry name="serial">549d5d40-8521-4a9b-abbd-f6319b5b393b</entry>
Aug 15 07:07:20 user nova-compute[72803]:       <entry name="uuid">549d5d40-8521-4a9b-abbd-f6319b5b393b</entry>
Aug 15 07:07:20 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:07:20 user nova-compute[72803]:     </system>
Aug 15 07:07:20 user nova-compute[72803]:   </sysinfo>
Aug 15 07:07:20 user nova-compute[72803]:   <os>
Aug 15 07:07:20 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:07:20 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:07:20 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:07:20 user nova-compute[72803]:   </os>
Aug 15 07:07:20 user nova-compute[72803]:   <features>
Aug 15 07:07:20 user nova-compute[72803]:     <acpi/>
Aug 15 07:07:20 user nova-compute[72803]:     <apic/>
Aug 15 07:07:20 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:07:20 user nova-compute[72803]:   </features>
Aug 15 07:07:20 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:07:20 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:07:20 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:07:20 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:07:20 user nova-compute[72803]:   </clock>
Aug 15 07:07:20 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:07:20 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:07:20 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:07:20 user nova-compute[72803]:   </cpu>
Aug 15 07:07:20 user nova-compute[72803]:   <devices>
Aug 15 07:07:20 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:07:20 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:07:20 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 07:07:20 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:07:20 user nova-compute[72803]:       <serial>65a376f5-1916-4ba2-a54e-da440b48eb1b</serial>
Aug 15 07:07:20 user nova-compute[72803]:     </disk>
Aug 15 07:07:20 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:07:20 user nova-compute[72803]:       <mac address="fa:16:3e:ae:41:07"/>
Aug 15 07:07:20 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:20 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:07:20 user nova-compute[72803]:       <target dev="tap7f5ebbd1-04"/>
Aug 15 07:07:20 user nova-compute[72803]:     </interface>
Aug 15 07:07:20 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:07:20 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/console.log" append="off"/>
Aug 15 07:07:20 user nova-compute[72803]:     </serial>
Aug 15 07:07:20 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:07:20 user nova-compute[72803]:     <video>
Aug 15 07:07:20 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:20 user nova-compute[72803]:     </video>
Aug 15 07:07:20 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:07:20 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:07:20 user nova-compute[72803]:     </rng>
Aug 15 07:07:20 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:07:20 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:07:20 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:07:20 user nova-compute[72803]:     </memballoon>
Aug 15 07:07:20 user nova-compute[72803]:   </devices>
Aug 15 07:07:20 user nova-compute[72803]: </domain>
Aug 15 07:07:20 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322158826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322158826',id=29,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-n98lymqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:06:56Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=549d5d40-8521-4a9b-abbd-f6319b5b393b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:41:07,bridge_name='br-int',has_traffic_filtering=True,id=7f5ebbd1-04cb-44df-a1a0-fe9979075501,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5ebbd1-04') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG os_vif [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:41:07,bridge_name='br-int',has_traffic_filtering=True,id=7f5ebbd1-04cb-44df-a1a0-fe9979075501,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5ebbd1-04') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f5ebbd1-04, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f5ebbd1-04, col_values=(('external_ids', {'iface-id': '7f5ebbd1-04cb-44df-a1a0-fe9979075501', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:41:07', 'vm-uuid': '549d5d40-8521-4a9b-abbd-f6319b5b393b'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:20 user nova-compute[72803]: INFO os_vif [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:41:07,bridge_name='br-int',has_traffic_filtering=True,id=7f5ebbd1-04cb-44df-a1a0-fe9979075501,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5ebbd1-04')
Aug 15 07:07:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No VIF found with MAC fa:16:3e:ae:41:07, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:07:20 user nova-compute[72803]: INFO nova.compute.claims [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Claim successful on node user
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:07:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:07:21 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:07:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG nova.policy [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1e4fd69d1a64b8d80b0d1a45d62190f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaf763674bc4aaca9e52eda0cf41f44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:07:21 user nova-compute[72803]: INFO nova.virt.block_device [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Booting with volume 739d0d35-77ef-4473-93c4-a7f1fe0171dc at /dev/vda
Aug 15 07:07:21 user nova-compute[72803]: DEBUG os_brick.utils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1907c85e-47b8-42c5-bf69-ef633aba513b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[64927925-bbfd-4944-a66e-b8e86a1c84d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b507b0e6-2822-4107-bffb-f1097aa4da9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[714859bb-7502-42b6-b28e-12a232254101]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:07:21 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:07:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4009b3-32f4-4eda-9792-790b5bd625d5]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG os_brick.utils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating existing volume attachment record: cfcaeaa9-ce01-4c4d-90fb-c52d29cdff30 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-3b8a9960-4aae-47d5-950d-08dabea22d5e req-415fe1d7-984c-4480-9cd8-0d181b304f2e service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b8a9960-4aae-47d5-950d-08dabea22d5e req-415fe1d7-984c-4480-9cd8-0d181b304f2e service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b8a9960-4aae-47d5-950d-08dabea22d5e req-415fe1d7-984c-4480-9cd8-0d181b304f2e service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3b8a9960-4aae-47d5-950d-08dabea22d5e req-415fe1d7-984c-4480-9cd8-0d181b304f2e service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-3b8a9960-4aae-47d5-950d-08dabea22d5e req-415fe1d7-984c-4480-9cd8-0d181b304f2e service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:22 user nova-compute[72803]: WARNING nova.compute.manager [req-3b8a9960-4aae-47d5-950d-08dabea22d5e req-415fe1d7-984c-4480-9cd8-0d181b304f2e service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state building and task_state spawning.
Aug 15 07:07:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Successfully created port: 26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuYVBRop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:22 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:22 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:22 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea50c66-48b6-4c42-a4d6-c904ec61407f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:07:22 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bf1de5-28db-4d85-a2d3-89cb28d9af8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5] added
Aug 15 07:07:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[802da5f8-7786-4516-943f-4a48407ccb2f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70e406d-aee1-4281-9435-017319b00555]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kuYVBRop {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kuYVBRop" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb47c35-6dde-498f-be05-03e5331ed1b1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kuYVBRop'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[930acaf1-ddf3-48bd-b2bf-6439d65b1cc4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6a85cc-9832-4a64-acb7-1e7a42e7e709]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Starting finish_migration {{(pid=72803) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance directory exists: not creating {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 07:07:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Creating image(s)
Aug 15 07:07:22 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b17118-f1bc-4b1c-951c-8024e22f70b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5, portal: 172.16.0.220,3260]
Aug 15 07:07:22 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5, portal: 172.16.0.220,3260] successful.
Aug 15 07:07:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da68d4-3e45-43b8-961b-9ca8496c45b8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4927e0e-f33c-465a-bdf7-9f5cf943d145]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)
Aug 15 07:07:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:22 user nova-compute[72803]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)
Aug 15 07:07:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5fb01c-6a48-4f09-b488-f9c97e91bd83]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuYVBRop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk. size=21474836480 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk 21474836480 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk 21474836480" returned: 0 in 0.165s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Ensure instance console log exists: /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Start _get_guest_xml network_info=[{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1617322884-network", "vif_mac": "fa:16:3e:32:4e:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'b79c7abe-bb0c-4b45-baaa-1cf9edb9a49b', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ae246e06-40b2-4c05-a7b7-63f016a8ea03', 'attached_at': '2023-08-15T07:07:22.000000', 'detached_at': '', 'volume_id': 'b3b23c9e-adc1-4800-bf40-740385364765', 'serial': 'b3b23c9e-adc1-4800-bf40-740385364765'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:07:23 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:23 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:23 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Successfully updated port: 26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquired lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9d00f0a3-03e1-49df-9781-76f5c584c509 req-3601f824-252c-46de-9f89-ac716912379c service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-changed-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-9d00f0a3-03e1-49df-9781-76f5c584c509 req-3601f824-252c-46de-9f89-ac716912379c service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Refreshing instance network info cache due to event network-changed-26906fc5-11d2-4df0-9f43-0a6df7e8de04. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d00f0a3-03e1-49df-9781-76f5c584c509 req-3601f824-252c-46de-9f89-ac716912379c service nova] Acquiring lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating instance_info_cache with network_info: [{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23338666565616162', 'path': '/dev/sde'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338666565616162', 'path': '/dev/sde'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.446s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:23 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:23 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Releasing lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance network_info: |[{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d00f0a3-03e1-49df-9781-76f5c584c509 req-3601f824-252c-46de-9f89-ac716912379c service nova] Acquired lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d00f0a3-03e1-49df-9781-76f5c584c509 req-3601f824-252c-46de-9f89-ac716912379c service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Refreshing network info cache for port 26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'flavor' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea6d4d-dd55-4125-90ed-57396915d2f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:07:23 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:07:23 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:07:23 user nova-compute[72803]:   <source dev="/dev/sde"/>
Aug 15 07:07:23 user nova-compute[72803]:   <target dev="vdc" bus="virtio"/>
Aug 15 07:07:23 user nova-compute[72803]:   <serial>722d6f0c-ed79-4806-91c8-d84b573295b5</serial>
Aug 15 07:07:23 user nova-compute[72803]: </disk>
Aug 15 07:07:23 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba4001a-14bc-4cf8-ac54-7dd7cea055db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765] added
Aug 15 07:07:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc5083d-a73f-4d96-b811-9032fb948830]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b72a30b-b443-48c1-9474-dc0e2fea4377]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmoIOEMV {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmoIOEMV" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3b61b7-eb06-46d8-be2d-732e6fd546b0]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmoIOEMV'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96c3dc1-152f-4297-a86d-56893376a7e4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b195441-4710-4a21-9de1-26e431e08f3e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:23 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:23 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:23 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:23 user nova-compute[72803]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)
Aug 15 07:07:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:23 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:23 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:23 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:23 user nova-compute[72803]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)
Aug 15 07:07:23 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:23 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[520cb4a3-f1ce-44ea-81d2-c479ec68ad05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]
Aug 15 07:07:24 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.
Aug 15 07:07:24 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e65e7e-9039-4852-a83f-74c7cecf6b14]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[831eecfb-31a2-4321-9f12-d25149c2cadd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:24 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)
Aug 15 07:07:24 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:24 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[391bda55-e510-4960-92f9-358b27fa1caa]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-f2a36a98-4d47-4d94-ad44-cca1da1b5d76 req-337df0d5-13e8-4506-b5ae-7a77d89e28b9 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2a36a98-4d47-4d94-ad44-cca1da1b5d76 req-337df0d5-13e8-4506-b5ae-7a77d89e28b9 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2a36a98-4d47-4d94-ad44-cca1da1b5d76 req-337df0d5-13e8-4506-b5ae-7a77d89e28b9 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2a36a98-4d47-4d94-ad44-cca1da1b5d76 req-337df0d5-13e8-4506-b5ae-7a77d89e28b9 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-f2a36a98-4d47-4d94-ad44-cca1da1b5d76 req-337df0d5-13e8-4506-b5ae-7a77d89e28b9 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:24 user nova-compute[72803]: WARNING nova.compute.manager [req-f2a36a98-4d47-4d94-ad44-cca1da1b5d76 req-337df0d5-13e8-4506-b5ae-7a77d89e28b9 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state building and task_state spawning.
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] No VIF found with MAC fa:16:3e:ee:2c:d1, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d00f0a3-03e1-49df-9781-76f5c584c509 req-3601f824-252c-46de-9f89-ac716912379c service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updated VIF entry in instance network info cache for port 26906fc5-11d2-4df0-9f43-0a6df7e8de04. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d00f0a3-03e1-49df-9781-76f5c584c509 req-3601f824-252c-46de-9f89-ac716912379c service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating instance_info_cache with network_info: [{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d00f0a3-03e1-49df-9781-76f5c584c509 req-3601f824-252c-46de-9f89-ac716912379c service nova] Releasing lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ff3cc074-5bb4-43a4-9160-edc24608bde9 tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.992s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083244.4235294, 549d5d40-8521-4a9b-abbd-f6319b5b393b => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] VM Resumed (Lifecycle Event)
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:07:24 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance spawned successfully.
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083244.4238846, 549d5d40-8521-4a9b-abbd-f6319b5b393b => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] VM Started (Lifecycle Event)
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:07:24 user nova-compute[72803]: INFO nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 15 07:07:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:24 user nova-compute[72803]: INFO nova.compute.manager [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Took 29.66 seconds to build instance.
Aug 15 07:07:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e6bb3ffc-2c38-4cb8-bd74-4a286e8e2264 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.783s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== connect_volume: return (1889ms) {'type': 'block', 'scsi_wwn': '23566396432616361', 'path': '/dev/sdf'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566396432616361', 'path': '/dev/sdf'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:25 user nova-compute[72803]: INFO nova.compute.manager [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Detaching volume 722d6f0c-ed79-4806-91c8-d84b573295b5
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1617322884-network", "vif_mac": "fa:16:3e:32:4e:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1617322884-network", "vif_mac": "fa:16:3e:32:4e:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:07:25 user nova-compute[72803]:   <uuid>ae246e06-40b2-4c05-a7b7-63f016a8ea03</uuid>
Aug 15 07:07:25 user nova-compute[72803]:   <name>instance-00000015</name>
Aug 15 07:07:25 user nova-compute[72803]:   <memory>2097152</memory>
Aug 15 07:07:25 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:07:25 user nova-compute[72803]:   <metadata>
Aug 15 07:07:25 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:07:25 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:07:25 user nova-compute[72803]:       <nova:name>tempest-ServerActionsTestOtherB-server-1170662677</nova:name>
Aug 15 07:07:25 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:07:23</nova:creationTime>
Aug 15 07:07:25 user nova-compute[72803]:       <nova:flavor name="m1.small">
Aug 15 07:07:25 user nova-compute[72803]:         <nova:memory>2048</nova:memory>
Aug 15 07:07:25 user nova-compute[72803]:         <nova:disk>20</nova:disk>
Aug 15 07:07:25 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:07:25 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:07:25 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:07:25 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:07:25 user nova-compute[72803]:       <nova:owner>
Aug 15 07:07:25 user nova-compute[72803]:         <nova:user uuid="701c79552e3044d0babde5510a994efa">tempest-ServerActionsTestOtherB-1808789614-project-member</nova:user>
Aug 15 07:07:25 user nova-compute[72803]:         <nova:project uuid="3de2e755df9744d59e93c26feeec4ebf">tempest-ServerActionsTestOtherB-1808789614</nova:project>
Aug 15 07:07:25 user nova-compute[72803]:       </nova:owner>
Aug 15 07:07:25 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:07:25 user nova-compute[72803]:       <nova:ports>
Aug 15 07:07:25 user nova-compute[72803]:         <nova:port uuid="89d1c280-dac6-41fa-8fb1-0d1b31c21f10">
Aug 15 07:07:25 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 07:07:25 user nova-compute[72803]:         </nova:port>
Aug 15 07:07:25 user nova-compute[72803]:       </nova:ports>
Aug 15 07:07:25 user nova-compute[72803]:     </nova:instance>
Aug 15 07:07:25 user nova-compute[72803]:   </metadata>
Aug 15 07:07:25 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:07:25 user nova-compute[72803]:     <system>
Aug 15 07:07:25 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:07:25 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:07:25 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:07:25 user nova-compute[72803]:       <entry name="serial">ae246e06-40b2-4c05-a7b7-63f016a8ea03</entry>
Aug 15 07:07:25 user nova-compute[72803]:       <entry name="uuid">ae246e06-40b2-4c05-a7b7-63f016a8ea03</entry>
Aug 15 07:07:25 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:07:25 user nova-compute[72803]:     </system>
Aug 15 07:07:25 user nova-compute[72803]:   </sysinfo>
Aug 15 07:07:25 user nova-compute[72803]:   <os>
Aug 15 07:07:25 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:07:25 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:07:25 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:07:25 user nova-compute[72803]:   </os>
Aug 15 07:07:25 user nova-compute[72803]:   <features>
Aug 15 07:07:25 user nova-compute[72803]:     <acpi/>
Aug 15 07:07:25 user nova-compute[72803]:     <apic/>
Aug 15 07:07:25 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:07:25 user nova-compute[72803]:   </features>
Aug 15 07:07:25 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:07:25 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:07:25 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:07:25 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:07:25 user nova-compute[72803]:   </clock>
Aug 15 07:07:25 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:07:25 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:07:25 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:07:25 user nova-compute[72803]:   </cpu>
Aug 15 07:07:25 user nova-compute[72803]:   <devices>
Aug 15 07:07:25 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:07:25 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:07:25 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk"/>
Aug 15 07:07:25 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:07:25 user nova-compute[72803]:     </disk>
Aug 15 07:07:25 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:07:25 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:07:25 user nova-compute[72803]:       <source dev="/dev/sdf"/>
Aug 15 07:07:25 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:07:25 user nova-compute[72803]:       <serial>b3b23c9e-adc1-4800-bf40-740385364765</serial>
Aug 15 07:07:25 user nova-compute[72803]:     </disk>
Aug 15 07:07:25 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:07:25 user nova-compute[72803]:       <mac address="fa:16:3e:32:4e:18"/>
Aug 15 07:07:25 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:25 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:07:25 user nova-compute[72803]:       <target dev="tap89d1c280-da"/>
Aug 15 07:07:25 user nova-compute[72803]:     </interface>
Aug 15 07:07:25 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:07:25 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/console.log" append="off"/>
Aug 15 07:07:25 user nova-compute[72803]:     </serial>
Aug 15 07:07:25 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:07:25 user nova-compute[72803]:     <video>
Aug 15 07:07:25 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:25 user nova-compute[72803]:     </video>
Aug 15 07:07:25 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:07:25 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:07:25 user nova-compute[72803]:     </rng>
Aug 15 07:07:25 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:07:25 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:07:25 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:07:25 user nova-compute[72803]:     </memballoon>
Aug 15 07:07:25 user nova-compute[72803]:   </devices>
Aug 15 07:07:25 user nova-compute[72803]: </domain>
Aug 15 07:07:25 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1617322884-network", "vif_mac": "fa:16:3e:32:4e:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1617322884-network", "vif_mac": "fa:16:3e:32:4e:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG os_vif [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89d1c280-da, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89d1c280-da, col_values=(('external_ids', {'iface-id': '89d1c280-dac6-41fa-8fb1-0d1b31c21f10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:4e:18', 'vm-uuid': 'ae246e06-40b2-4c05-a7b7-63f016a8ea03'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:25 user nova-compute[72803]: INFO os_vif [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da')
Aug 15 07:07:25 user nova-compute[72803]: INFO nova.virt.block_device [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Attempting to driver detach volume 722d6f0c-ed79-4806-91c8-d84b573295b5 from mountpoint /dev/vdc
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Attempting to detach device vdc from instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:07:25 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:07:25 user nova-compute[72803]:   <source dev="/dev/sde"/>
Aug 15 07:07:25 user nova-compute[72803]:   <target dev="vdc" bus="virtio"/>
Aug 15 07:07:25 user nova-compute[72803]:   <serial>722d6f0c-ed79-4806-91c8-d84b573295b5</serial>
Aug 15 07:07:25 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 07:07:25 user nova-compute[72803]: </disk>
Aug 15 07:07:25 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:07:25 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Successfully detached device vdc from instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d from the persistent domain config.
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:07:25 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:07:25 user nova-compute[72803]:   <source dev="/dev/sde"/>
Aug 15 07:07:25 user nova-compute[72803]:   <target dev="vdc" bus="virtio"/>
Aug 15 07:07:25 user nova-compute[72803]:   <serial>722d6f0c-ed79-4806-91c8-d84b573295b5</serial>
Aug 15 07:07:25 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 07:07:25 user nova-compute[72803]: </disk>
Aug 15 07:07:25 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] No VIF found with MAC fa:16:3e:32:4e:18, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083246.0446908, 9c7018fa-ebd1-4446-a8ca-f775ee3a570d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:07:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Successfully detached device vdc from instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d from the live domain config.
Aug 15 07:07:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kuYVBRop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:26 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6e74c-8450-494f-be0c-4b6c811e31b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[37606c25-3162-4395-8ab7-8804706156c8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 (non-flash)
Aug 15 07:07:26 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f350c91e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5'): ({'sde'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Removing single pathed devices sde {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb298faa-7c0b-4446-94d5-285fcdab26a1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[08122244-d4bc-4ab6-b184-7d078908d482]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Flushing IO for device /dev/sde {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63eb84f-f679-41e9-ad7b-8ca9b282ee60]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ac06a0-8ad3-4a6b-960d-c9cb7322dcb7]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] SCSI volumes sde have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aa1d03-c162-4966-883e-325c2bc93709]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ed03e-2db0-45cb-8204-571b9e3875d9]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5, portal: 172.16.0.220,3260]
Aug 15 07:07:26 user nova-compute[72803]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5, portal: 172.16.0.220,3260] successful.
Aug 15 07:07:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722d6f0c-ed79-4806-91c8-d84b573295b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77807fc-c029-4a06-8b53-9d2cfd3ad807]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] <== disconnect_volume: return (380ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'flavor' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a60e2f26-38cf-48f5-848f-74c4915a6e4d tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.498s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-37eb5740-cc4a-47fa-b5b7-33158514b1af req-189902c5-c04e-4a7d-b3a4-f9fdf68ae16f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-37eb5740-cc4a-47fa-b5b7-33158514b1af req-189902c5-c04e-4a7d-b3a4-f9fdf68ae16f service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-37eb5740-cc4a-47fa-b5b7-33158514b1af req-189902c5-c04e-4a7d-b3a4-f9fdf68ae16f service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-37eb5740-cc4a-47fa-b5b7-33158514b1af req-189902c5-c04e-4a7d-b3a4-f9fdf68ae16f service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-37eb5740-cc4a-47fa-b5b7-33158514b1af req-189902c5-c04e-4a7d-b3a4-f9fdf68ae16f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:27 user nova-compute[72803]: WARNING nova.compute.manager [req-37eb5740-cc4a-47fa-b5b7-33158514b1af req-189902c5-c04e-4a7d-b3a4-f9fdf68ae16f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state resize_finish.
Aug 15 07:07:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-acc17067-5427-4882-a8a7-e91db10e36c6 req-13c83f31-447a-4919-ac2e-d40dbfde9fc4 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-acc17067-5427-4882-a8a7-e91db10e36c6 req-13c83f31-447a-4919-ac2e-d40dbfde9fc4 service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-acc17067-5427-4882-a8a7-e91db10e36c6 req-13c83f31-447a-4919-ac2e-d40dbfde9fc4 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-acc17067-5427-4882-a8a7-e91db10e36c6 req-13c83f31-447a-4919-ac2e-d40dbfde9fc4 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-acc17067-5427-4882-a8a7-e91db10e36c6 req-13c83f31-447a-4919-ac2e-d40dbfde9fc4 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:29 user nova-compute[72803]: WARNING nova.compute.manager [req-acc17067-5427-4882-a8a7-e91db10e36c6 req-13c83f31-447a-4919-ac2e-d40dbfde9fc4 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state resize_finish.
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083249.8044941, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Resumed (Lifecycle Event)
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:07:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance running successfully.
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Failed to set time: agent not configured {{(pid=72803) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8fa9fff2-5e87-4588-849d-d2d3ae484c39 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] finish_migration finished successfully. {{(pid=72803) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083249.8060687, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Started (Lifecycle Event)
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:29 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 07:07:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:07:33 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Creating image(s)
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Ensure instance console log exists: /opt/stack/data/nova/instances/36431f5c-df19-4836-ae18-8e9f7ae8d066/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Start _get_guest_xml network_info=[{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'cfcaeaa9-ce01-4c4d-90fb-c52d29cdff30', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyqlsaTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36431f5c-df19-4836-ae18-8e9f7ae8d066', 'attached_at': '', 'detached_at': '', 'volume_id': '739d0d35-77ef-4473-93c4-a7f1fe0171dc', 'serial': '739d0d35-77ef-4473-93c4-a7f1fe0171dc'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:07:33 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:33 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyqlsaTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:07:33 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:33 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:07:33 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9db9e41-d089-4530-9865-3551d2d3f48f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:07:33 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1a9092-7780-4905-9375-a6e2f425a6d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc] added
Aug 15 07:07:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c643c0a-978f-43b0-82ef-db27483538e9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf4de69-0e94-4128-a527-0306f579d13b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyqlsaTU {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyqlsaTU" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b18a49-9892-4acd-95b4-f475aeee1eb2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uyqlsaTU'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.148s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa3756-ad2d-4033-b713-36efdbfe5b3e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecd03c3-ffae-4a9f-b0ce-84cbabb1f3f0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:33 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:33 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:33 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:33 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:33 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:33 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:33 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:33 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[749fda29-caf2-4105-bf49-dc600ac92e2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260]
Aug 15 07:07:34 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260] successful.
Aug 15 07:07:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab7e344-4ebf-413c-91f1-b446e150c6b1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ce8895-8866-468e-9767-5a0c5e5c3f35]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:07:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:07:34 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:07:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.472s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f822e5da-b5e7-4dfc-b7c6-7261b650c5e3]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:34 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyqlsaTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== connect_volume: return (1504ms) {'type': 'block', 'scsi_wwn': '23530636465623634', 'path': '/dev/sde'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530636465623634', 'path': '/dev/sde'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1694780471',display_name='tempest-ServerActionsTestOtherA-server-1694780471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1694780471',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-danqw2ac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:07:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=36431f5c-df19-4836-ae18-8e9f7ae8d066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.objects.instance [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'pci_devices' on Instance uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:07:35 user nova-compute[72803]:   <uuid>36431f5c-df19-4836-ae18-8e9f7ae8d066</uuid>
Aug 15 07:07:35 user nova-compute[72803]:   <name>instance-0000001e</name>
Aug 15 07:07:35 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:07:35 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:07:35 user nova-compute[72803]:   <metadata>
Aug 15 07:07:35 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:07:35 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:07:35 user nova-compute[72803]:       <nova:name>tempest-ServerActionsTestOtherA-server-1694780471</nova:name>
Aug 15 07:07:35 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:07:33</nova:creationTime>
Aug 15 07:07:35 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:07:35 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:07:35 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:07:35 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:07:35 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:07:35 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:07:35 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:07:35 user nova-compute[72803]:       <nova:owner>
Aug 15 07:07:35 user nova-compute[72803]:         <nova:user uuid="f1e4fd69d1a64b8d80b0d1a45d62190f">tempest-ServerActionsTestOtherA-931999183-project-member</nova:user>
Aug 15 07:07:35 user nova-compute[72803]:         <nova:project uuid="ecaf763674bc4aaca9e52eda0cf41f44">tempest-ServerActionsTestOtherA-931999183</nova:project>
Aug 15 07:07:35 user nova-compute[72803]:       </nova:owner>
Aug 15 07:07:35 user nova-compute[72803]:       <nova:ports>
Aug 15 07:07:35 user nova-compute[72803]:         <nova:port uuid="26906fc5-11d2-4df0-9f43-0a6df7e8de04">
Aug 15 07:07:35 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 07:07:35 user nova-compute[72803]:         </nova:port>
Aug 15 07:07:35 user nova-compute[72803]:       </nova:ports>
Aug 15 07:07:35 user nova-compute[72803]:     </nova:instance>
Aug 15 07:07:35 user nova-compute[72803]:   </metadata>
Aug 15 07:07:35 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:07:35 user nova-compute[72803]:     <system>
Aug 15 07:07:35 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:07:35 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:07:35 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:07:35 user nova-compute[72803]:       <entry name="serial">36431f5c-df19-4836-ae18-8e9f7ae8d066</entry>
Aug 15 07:07:35 user nova-compute[72803]:       <entry name="uuid">36431f5c-df19-4836-ae18-8e9f7ae8d066</entry>
Aug 15 07:07:35 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:07:35 user nova-compute[72803]:     </system>
Aug 15 07:07:35 user nova-compute[72803]:   </sysinfo>
Aug 15 07:07:35 user nova-compute[72803]:   <os>
Aug 15 07:07:35 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:07:35 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:07:35 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:07:35 user nova-compute[72803]:   </os>
Aug 15 07:07:35 user nova-compute[72803]:   <features>
Aug 15 07:07:35 user nova-compute[72803]:     <acpi/>
Aug 15 07:07:35 user nova-compute[72803]:     <apic/>
Aug 15 07:07:35 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:07:35 user nova-compute[72803]:   </features>
Aug 15 07:07:35 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:07:35 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:07:35 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:07:35 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:07:35 user nova-compute[72803]:   </clock>
Aug 15 07:07:35 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:07:35 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:07:35 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:07:35 user nova-compute[72803]:   </cpu>
Aug 15 07:07:35 user nova-compute[72803]:   <devices>
Aug 15 07:07:35 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:07:35 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:07:35 user nova-compute[72803]:       <source dev="/dev/sde"/>
Aug 15 07:07:35 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:07:35 user nova-compute[72803]:       <serial>739d0d35-77ef-4473-93c4-a7f1fe0171dc</serial>
Aug 15 07:07:35 user nova-compute[72803]:     </disk>
Aug 15 07:07:35 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:07:35 user nova-compute[72803]:       <mac address="fa:16:3e:a8:4c:68"/>
Aug 15 07:07:35 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:35 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:07:35 user nova-compute[72803]:       <target dev="tap26906fc5-11"/>
Aug 15 07:07:35 user nova-compute[72803]:     </interface>
Aug 15 07:07:35 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:07:35 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/36431f5c-df19-4836-ae18-8e9f7ae8d066/console.log" append="off"/>
Aug 15 07:07:35 user nova-compute[72803]:     </serial>
Aug 15 07:07:35 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:07:35 user nova-compute[72803]:     <video>
Aug 15 07:07:35 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:35 user nova-compute[72803]:     </video>
Aug 15 07:07:35 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:07:35 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:07:35 user nova-compute[72803]:     </rng>
Aug 15 07:07:35 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:07:35 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:07:35 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:07:35 user nova-compute[72803]:     </memballoon>
Aug 15 07:07:35 user nova-compute[72803]:   </devices>
Aug 15 07:07:35 user nova-compute[72803]: </domain>
Aug 15 07:07:35 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1694780471',display_name='tempest-ServerActionsTestOtherA-server-1694780471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1694780471',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-danqw2ac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:07:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=36431f5c-df19-4836-ae18-8e9f7ae8d066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG os_vif [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26906fc5-11, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26906fc5-11, col_values=(('external_ids', {'iface-id': '26906fc5-11d2-4df0-9f43-0a6df7e8de04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:4c:68', 'vm-uuid': '36431f5c-df19-4836-ae18-8e9f7ae8d066'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:35 user nova-compute[72803]: INFO os_vif [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11')
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No VIF found with MAC fa:16:3e:a8:4c:68, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:07:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-f20c63b4-8c53-475a-a720-7ad87f0652b3 req-5b9d9e2c-5f14-46cd-8f38-09fc969010a5 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f20c63b4-8c53-475a-a720-7ad87f0652b3 req-5b9d9e2c-5f14-46cd-8f38-09fc969010a5 service nova] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f20c63b4-8c53-475a-a720-7ad87f0652b3 req-5b9d9e2c-5f14-46cd-8f38-09fc969010a5 service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f20c63b4-8c53-475a-a720-7ad87f0652b3 req-5b9d9e2c-5f14-46cd-8f38-09fc969010a5 service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-f20c63b4-8c53-475a-a720-7ad87f0652b3 req-5b9d9e2c-5f14-46cd-8f38-09fc969010a5 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] No waiting events found dispatching network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:37 user nova-compute[72803]: WARNING nova.compute.manager [req-f20c63b4-8c53-475a-a720-7ad87f0652b3 req-5b9d9e2c-5f14-46cd-8f38-09fc969010a5 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received unexpected event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 for instance with vm_state building and task_state spawning.
Aug 15 07:07:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:07:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:07:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:07:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:07:38 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083258.9553752, 36431f5c-df19-4836-ae18-8e9f7ae8d066 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:38 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] VM Resumed (Lifecycle Event)
Aug 15 07:07:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:07:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:07:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance spawned successfully.
Aug 15 07:07:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:07:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:07:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083258.9635546, 36431f5c-df19-4836-ae18-8e9f7ae8d066 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:07:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] VM Started (Lifecycle Event)
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:07:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:07:39 user nova-compute[72803]: INFO nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:07:39 user nova-compute[72803]: INFO nova.compute.manager [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Took 18.88 seconds to build instance.
Aug 15 07:07:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-60531623-c5e8-430a-8bd6-edb02a07f127 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.017s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-cbbd6ce4-a10a-44e4-b9f3-cc74f618c165 req-7e99c7e5-1efd-4bbb-b05e-0cdacd9dedd4 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cbbd6ce4-a10a-44e4-b9f3-cc74f618c165 req-7e99c7e5-1efd-4bbb-b05e-0cdacd9dedd4 service nova] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cbbd6ce4-a10a-44e4-b9f3-cc74f618c165 req-7e99c7e5-1efd-4bbb-b05e-0cdacd9dedd4 service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cbbd6ce4-a10a-44e4-b9f3-cc74f618c165 req-7e99c7e5-1efd-4bbb-b05e-0cdacd9dedd4 service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-cbbd6ce4-a10a-44e4-b9f3-cc74f618c165 req-7e99c7e5-1efd-4bbb-b05e-0cdacd9dedd4 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] No waiting events found dispatching network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:39 user nova-compute[72803]: WARNING nova.compute.manager [req-cbbd6ce4-a10a-44e4-b9f3-cc74f618c165 req-7e99c7e5-1efd-4bbb-b05e-0cdacd9dedd4 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received unexpected event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 for instance with vm_state active and task_state None.
Aug 15 07:07:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:41 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:07:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:43 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:07:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:07:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:47 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:47 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7293MB free_disk=25.29876708984375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Applying migration context for instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 as it has an incoming, in-progress migration 486cc2fb-4672-45ba-aa57-40b6786f152b. Migration status is finished {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 07:07:47 user nova-compute[72803]: INFO nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating resource usage from migration 486cc2fb-4672-45ba-aa57-40b6786f152b
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 506ed7b9-6081-418b-86a8-278db430893e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 549d5d40-8521-4a9b-abbd-f6319b5b393b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Migration 486cc2fb-4672-45ba-aa57-40b6786f152b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:07:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:07:48 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:07:48 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:07:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:07:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:07:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:54 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:07:54 user nova-compute[72803]: INFO nova.compute.claims [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Claim successful on node user
Aug 15 07:07:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.838s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:07:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.policy [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c445be5492b44a4ac0ab0ffb9bf6b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415992ab9c124f2db890795802e64ed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:07:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Creating image(s)
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "/opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "/opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk 1073741824" returned: 0 in 0.054s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Successfully created port: b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Cannot resize image /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'migration_context' on Instance uuid 6e24f20a-5872-4b4b-bbad-0528fe4ec73b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Ensure instance console log exists: /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Successfully updated port: b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquired lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-b24bd8f2-6ab6-472b-83c7-b24fa4b3adc2 req-e291a55c-29a6-46df-80b3-90f9396e825d service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received event network-changed-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-b24bd8f2-6ab6-472b-83c7-b24fa4b3adc2 req-e291a55c-29a6-46df-80b3-90f9396e825d service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Refreshing instance network info cache due to event network-changed-b853d6f0-5d40-4009-8395-1fe7551bd84f. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b24bd8f2-6ab6-472b-83c7-b24fa4b3adc2 req-e291a55c-29a6-46df-80b3-90f9396e825d service nova] Acquiring lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:07:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Updating instance_info_cache with network_info: [{"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Releasing lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Instance network_info: |[{"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b24bd8f2-6ab6-472b-83c7-b24fa4b3adc2 req-e291a55c-29a6-46df-80b3-90f9396e825d service nova] Acquired lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-b24bd8f2-6ab6-472b-83c7-b24fa4b3adc2 req-e291a55c-29a6-46df-80b3-90f9396e825d service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Refreshing network info cache for port b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Start _get_guest_xml network_info=[{"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:07:58 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:58 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-408434374',display_name='tempest-VolumesSnapshotTestJSON-instance-408434374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-408434374',id=31,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjE2kfHSvo8LIX48QWA260a/+z5iBb55LF1UXK9VcXqthjlS+K1Pv//+dE5Wbq/n11MMOA/EX1OnWxs62o93oFA20SaVE2dkmKmy+LzjNc9SyO+eo3VH+aNLHqPYnSKJg==',key_name='tempest-keypair-306153436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415992ab9c124f2db890795802e64ed3',ramdisk_id='',reservation_id='r-igla949k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1700542254',owner_user_name='tempest-VolumesSnapshotTestJSON-1700542254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c445be5492b44a4ac0ab0ffb9bf6b61',uuid=6e24f20a-5872-4b4b-bbad-0528fe4ec73b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converting VIF {"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:79:10,bridge_name='br-int',has_traffic_filtering=True,id=b853d6f0-5d40-4009-8395-1fe7551bd84f,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb853d6f0-5d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e24f20a-5872-4b4b-bbad-0528fe4ec73b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:07:58 user nova-compute[72803]:   <uuid>6e24f20a-5872-4b4b-bbad-0528fe4ec73b</uuid>
Aug 15 07:07:58 user nova-compute[72803]:   <name>instance-0000001f</name>
Aug 15 07:07:58 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:07:58 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:07:58 user nova-compute[72803]:   <metadata>
Aug 15 07:07:58 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:07:58 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:07:58 user nova-compute[72803]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-408434374</nova:name>
Aug 15 07:07:58 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:07:58</nova:creationTime>
Aug 15 07:07:58 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:07:58 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:07:58 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:07:58 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:07:58 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:07:58 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:07:58 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:07:58 user nova-compute[72803]:       <nova:owner>
Aug 15 07:07:58 user nova-compute[72803]:         <nova:user uuid="9c445be5492b44a4ac0ab0ffb9bf6b61">tempest-VolumesSnapshotTestJSON-1700542254-project-member</nova:user>
Aug 15 07:07:58 user nova-compute[72803]:         <nova:project uuid="415992ab9c124f2db890795802e64ed3">tempest-VolumesSnapshotTestJSON-1700542254</nova:project>
Aug 15 07:07:58 user nova-compute[72803]:       </nova:owner>
Aug 15 07:07:58 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:07:58 user nova-compute[72803]:       <nova:ports>
Aug 15 07:07:58 user nova-compute[72803]:         <nova:port uuid="b853d6f0-5d40-4009-8395-1fe7551bd84f">
Aug 15 07:07:58 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 07:07:58 user nova-compute[72803]:         </nova:port>
Aug 15 07:07:58 user nova-compute[72803]:       </nova:ports>
Aug 15 07:07:58 user nova-compute[72803]:     </nova:instance>
Aug 15 07:07:58 user nova-compute[72803]:   </metadata>
Aug 15 07:07:58 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:07:58 user nova-compute[72803]:     <system>
Aug 15 07:07:58 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:07:58 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:07:58 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:07:58 user nova-compute[72803]:       <entry name="serial">6e24f20a-5872-4b4b-bbad-0528fe4ec73b</entry>
Aug 15 07:07:58 user nova-compute[72803]:       <entry name="uuid">6e24f20a-5872-4b4b-bbad-0528fe4ec73b</entry>
Aug 15 07:07:58 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:07:58 user nova-compute[72803]:     </system>
Aug 15 07:07:58 user nova-compute[72803]:   </sysinfo>
Aug 15 07:07:58 user nova-compute[72803]:   <os>
Aug 15 07:07:58 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:07:58 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:07:58 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:07:58 user nova-compute[72803]:   </os>
Aug 15 07:07:58 user nova-compute[72803]:   <features>
Aug 15 07:07:58 user nova-compute[72803]:     <acpi/>
Aug 15 07:07:58 user nova-compute[72803]:     <apic/>
Aug 15 07:07:58 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:07:58 user nova-compute[72803]:   </features>
Aug 15 07:07:58 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:07:58 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:07:58 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:07:58 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:07:58 user nova-compute[72803]:   </clock>
Aug 15 07:07:58 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:07:58 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:07:58 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:07:58 user nova-compute[72803]:   </cpu>
Aug 15 07:07:58 user nova-compute[72803]:   <devices>
Aug 15 07:07:58 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:07:58 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:07:58 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk"/>
Aug 15 07:07:58 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:07:58 user nova-compute[72803]:     </disk>
Aug 15 07:07:58 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:07:58 user nova-compute[72803]:       <mac address="fa:16:3e:d2:79:10"/>
Aug 15 07:07:58 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:58 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:07:58 user nova-compute[72803]:       <target dev="tapb853d6f0-5d"/>
Aug 15 07:07:58 user nova-compute[72803]:     </interface>
Aug 15 07:07:58 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:07:58 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/console.log" append="off"/>
Aug 15 07:07:58 user nova-compute[72803]:     </serial>
Aug 15 07:07:58 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:07:58 user nova-compute[72803]:     <video>
Aug 15 07:07:58 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:07:58 user nova-compute[72803]:     </video>
Aug 15 07:07:58 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:07:58 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:07:58 user nova-compute[72803]:     </rng>
Aug 15 07:07:58 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:07:58 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:07:58 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:07:58 user nova-compute[72803]:     </memballoon>
Aug 15 07:07:58 user nova-compute[72803]:   </devices>
Aug 15 07:07:58 user nova-compute[72803]: </domain>
Aug 15 07:07:58 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-408434374',display_name='tempest-VolumesSnapshotTestJSON-instance-408434374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-408434374',id=31,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjE2kfHSvo8LIX48QWA260a/+z5iBb55LF1UXK9VcXqthjlS+K1Pv//+dE5Wbq/n11MMOA/EX1OnWxs62o93oFA20SaVE2dkmKmy+LzjNc9SyO+eo3VH+aNLHqPYnSKJg==',key_name='tempest-keypair-306153436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415992ab9c124f2db890795802e64ed3',ramdisk_id='',reservation_id='r-igla949k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1700542254',owner_user_name='tempest-VolumesSnapshotTestJSON-1700542254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c445be5492b44a4ac0ab0ffb9bf6b61',uuid=6e24f20a-5872-4b4b-bbad-0528fe4ec73b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converting VIF {"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:79:10,bridge_name='br-int',has_traffic_filtering=True,id=b853d6f0-5d40-4009-8395-1fe7551bd84f,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb853d6f0-5d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG os_vif [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:79:10,bridge_name='br-int',has_traffic_filtering=True,id=b853d6f0-5d40-4009-8395-1fe7551bd84f,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb853d6f0-5d') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb853d6f0-5d, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb853d6f0-5d, col_values=(('external_ids', {'iface-id': 'b853d6f0-5d40-4009-8395-1fe7551bd84f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:79:10', 'vm-uuid': '6e24f20a-5872-4b4b-bbad-0528fe4ec73b'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:58 user nova-compute[72803]: INFO os_vif [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:79:10,bridge_name='br-int',has_traffic_filtering=True,id=b853d6f0-5d40-4009-8395-1fe7551bd84f,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb853d6f0-5d')
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No VIF found with MAC fa:16:3e:d2:79:10, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-b24bd8f2-6ab6-472b-83c7-b24fa4b3adc2 req-e291a55c-29a6-46df-80b3-90f9396e825d service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Updated VIF entry in instance network info cache for port b853d6f0-5d40-4009-8395-1fe7551bd84f. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-b24bd8f2-6ab6-472b-83c7-b24fa4b3adc2 req-e291a55c-29a6-46df-80b3-90f9396e825d service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Updating instance_info_cache with network_info: [{"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:07:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b24bd8f2-6ab6-472b-83c7-b24fa4b3adc2 req-e291a55c-29a6-46df-80b3-90f9396e825d service nova] Releasing lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-cd0515f9-d80c-4ce7-83bf-4d9e18be5ad3 req-3fc0d68f-d402-4546-abff-bc1459bf9e43 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received event network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cd0515f9-d80c-4ce7-83bf-4d9e18be5ad3 req-3fc0d68f-d402-4546-abff-bc1459bf9e43 service nova] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cd0515f9-d80c-4ce7-83bf-4d9e18be5ad3 req-3fc0d68f-d402-4546-abff-bc1459bf9e43 service nova] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cd0515f9-d80c-4ce7-83bf-4d9e18be5ad3 req-3fc0d68f-d402-4546-abff-bc1459bf9e43 service nova] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:07:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-cd0515f9-d80c-4ce7-83bf-4d9e18be5ad3 req-3fc0d68f-d402-4546-abff-bc1459bf9e43 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] No waiting events found dispatching network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:07:59 user nova-compute[72803]: WARNING nova.compute.manager [req-cd0515f9-d80c-4ce7-83bf-4d9e18be5ad3 req-3fc0d68f-d402-4546-abff-bc1459bf9e43 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received unexpected event network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f for instance with vm_state building and task_state spawning.
Aug 15 07:08:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-87f7f886-9e4b-48eb-b67e-e6421d778565 req-f5f60d1d-403b-4928-8a86-1b23f1eed773 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-87f7f886-9e4b-48eb-b67e-e6421d778565 req-f5f60d1d-403b-4928-8a86-1b23f1eed773 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing instance network info cache due to event network-changed-2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-87f7f886-9e4b-48eb-b67e-e6421d778565 req-f5f60d1d-403b-4928-8a86-1b23f1eed773 service nova] Acquiring lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-87f7f886-9e4b-48eb-b67e-e6421d778565 req-f5f60d1d-403b-4928-8a86-1b23f1eed773 service nova] Acquired lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-87f7f886-9e4b-48eb-b67e-e6421d778565 req-f5f60d1d-403b-4928-8a86-1b23f1eed773 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Refreshing network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:01 user nova-compute[72803]: INFO nova.compute.manager [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Terminating instance
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-87f7f886-9e4b-48eb-b67e-e6421d778565 req-f5f60d1d-403b-4928-8a86-1b23f1eed773 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updated VIF entry in instance network info cache for port 2e2cc686-e80f-439a-87d6-36f6b8dba07d. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-87f7f886-9e4b-48eb-b67e-e6421d778565 req-f5f60d1d-403b-4928-8a86-1b23f1eed773 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [{"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-87f7f886-9e4b-48eb-b67e-e6421d778565 req-f5f60d1d-403b-4928-8a86-1b23f1eed773 service nova] Releasing lock "refresh_cache-506ed7b9-6081-418b-86a8-278db430893e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083281.8794224, 6e24f20a-5872-4b4b-bbad-0528fe4ec73b => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:08:01 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] VM Resumed (Lifecycle Event)
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:08:01 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Instance spawned successfully.
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:08:01 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083281.8849013, 6e24f20a-5872-4b4b-bbad-0528fe4ec73b => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:08:01 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] VM Started (Lifecycle Event)
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:08:02 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3fbeefc1-8198-44e6-a527-43eec254bfbf req-a8d03fee-db2c-4415-a1ea-7b3b1763a9bc service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received event network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3fbeefc1-8198-44e6-a527-43eec254bfbf req-a8d03fee-db2c-4415-a1ea-7b3b1763a9bc service nova] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3fbeefc1-8198-44e6-a527-43eec254bfbf req-a8d03fee-db2c-4415-a1ea-7b3b1763a9bc service nova] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3fbeefc1-8198-44e6-a527-43eec254bfbf req-a8d03fee-db2c-4415-a1ea-7b3b1763a9bc service nova] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3fbeefc1-8198-44e6-a527-43eec254bfbf req-a8d03fee-db2c-4415-a1ea-7b3b1763a9bc service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] No waiting events found dispatching network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:02 user nova-compute[72803]: WARNING nova.compute.manager [req-3fbeefc1-8198-44e6-a527-43eec254bfbf req-a8d03fee-db2c-4415-a1ea-7b3b1763a9bc service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received unexpected event network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f for instance with vm_state building and task_state spawning.
Aug 15 07:08:02 user nova-compute[72803]: INFO nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Instance destroyed successfully.
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.objects.instance [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lazy-loading 'resources' on Instance uuid 506ed7b9-6081-418b-86a8-278db430893e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1082719568',display_name='tempest-TestShelveInstance-server-1082719568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1082719568',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbYx1mHtDaQkRYxVSgFx3/zYCh0BDptX/w5QUs6vm39XSEWJ8BZXfgKtz7t3wTUrOUYvJerQtU9Q87bW4thFUZhERMvyG/uzW6UFIBtCRlr89WUEXAWXxHYx2ImaDYi8g==',key_name='tempest-TestShelveInstance-2020944849',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ba0ba51fa2449daae318ca760c32784',ramdisk_id='',reservation_id='r-pyv4bacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1431210887',owner_user_name='tempest-TestShelveInstance-1431210887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:06:30Z,user_data=None,user_id='10b9814cfdf2413c9d0ed361ed3aa46d',uuid=506ed7b9-6081-418b-86a8-278db430893e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converting VIF {"id": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "address": "fa:16:3e:75:c6:b7", "network": {"id": "86531fd4-5a03-4a91-ae2f-36bc4a4df3d0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1908591345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba0ba51fa2449daae318ca760c32784", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2cc686-e8", "ovs_interfaceid": "2e2cc686-e80f-439a-87d6-36f6b8dba07d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_vif [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e2cc686-e8, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:02 user nova-compute[72803]: INFO os_vif [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:c6:b7,bridge_name='br-int',has_traffic_filtering=True,id=2e2cc686-e80f-439a-87d6-36f6b8dba07d,network=Network(86531fd4-5a03-4a91-ae2f-36bc4a4df3d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2cc686-e8')
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxVByZMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:08:02 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: INFO nova.compute.manager [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Took 7.67 seconds to build instance.
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2d1794-73f0-454a-92a9-3a2df93020e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d6b8a2c7-46da-4ee9-a567-d9346c6674d7 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.768s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd0156b-cfe3-41d5-ae53-436a41ddeafc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:02 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e0604670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166b48e-be5f-4dde-b851-cb8701d559a7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe59e68-35f9-42c6-96b3-e5b6d750aa34]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d233b9a-5c20-47ee-a55f-fb0bcc0021be]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7a675-cfe8-475f-a4e2-832419090e38]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6c0b6bc0-dad767d3dac974c5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6c0b6bc0', '/dev/disk/by-id/scsi-26461643736376433') {{(pid=84151) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 07:08:02 user nova-compute[72803]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO6c0b6bc0-dad767d3dac974c5
Aug 15 07:08:02 user nova-compute[72803]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_6c0b6bc0
Aug 15 07:08:02 user nova-compute[72803]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26461643736376433
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[77da27a5-b575-469b-9345-58ae5dc7cfc3]: (4, None) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a7e69-12e6-4c8d-8dc4-6b16c3aabb13]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d6803f-9970-42ce-bfe3-03c6039ca298]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260]
Aug 15 07:08:02 user nova-compute[72803]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a, portal: 172.16.0.220,3260] successful.
Aug 15 07:08:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12fd62d1-26cb-42f9-a2c5-9b601d7fac9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca0c1c8-c61d-4703-a553-591ea92fbd8b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] <== disconnect_volume: return (383ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:08:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Deleting instance files /opt/stack/data/nova/instances/506ed7b9-6081-418b-86a8-278db430893e_del
Aug 15 07:08:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Deletion of /opt/stack/data/nova/instances/506ed7b9-6081-418b-86a8-278db430893e_del complete
Aug 15 07:08:02 user nova-compute[72803]: INFO nova.compute.manager [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 15 07:08:02 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:08:02 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:03 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Took 0.60 seconds to deallocate network for instance.
Aug 15 07:08:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-unplugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] No waiting events found dispatching network-vif-unplugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-unplugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] Acquiring lock "506ed7b9-6081-418b-86a8-278db430893e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] Lock "506ed7b9-6081-418b-86a8-278db430893e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] No waiting events found dispatching network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:03 user nova-compute[72803]: WARNING nova.compute.manager [req-f90810b3-a400-4cea-a234-494a7f0ac710 req-b298d9ee-5cea-4526-b506-4859b5e5e725 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received unexpected event network-vif-plugged-2e2cc686-e80f-439a-87d6-36f6b8dba07d for instance with vm_state active and task_state deleting.
Aug 15 07:08:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-b2bca484-ade5-4606-b8a0-071ae9729f46 req-31fb4222-680f-46ab-a4f7-f8f25faf80e9 service nova] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Received event network-vif-deleted-2e2cc686-e80f-439a-87d6-36f6b8dba07d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:04 user nova-compute[72803]: INFO nova.compute.manager [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Took 1.15 seconds to detach 1 volumes for instance.
Aug 15 07:08:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Deleting volume: 12fd62d1-26cb-42f9-a2c5-9b601d7fac9a {{(pid=72803) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 07:08:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:04 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:08:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:08:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:05 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Deleted allocations for instance 506ed7b9-6081-418b-86a8-278db430893e
Aug 15 07:08:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79ea493b-5baa-4af4-9e9c-9ecdac05a2f5 tempest-TestShelveInstance-1431210887 tempest-TestShelveInstance-1431210887-project-member] Lock "506ed7b9-6081-418b-86a8-278db430893e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.890s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-2185e2cb-45dc-41c5-89e5-4b46bdb4168d req-22a8a28f-a831-43a7-822b-bfd46d8ff2f8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received event network-changed-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-2185e2cb-45dc-41c5-89e5-4b46bdb4168d req-22a8a28f-a831-43a7-822b-bfd46d8ff2f8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Refreshing instance network info cache due to event network-changed-6609e26a-f730-45fe-b69c-f2ae2c72afc3. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2185e2cb-45dc-41c5-89e5-4b46bdb4168d req-22a8a28f-a831-43a7-822b-bfd46d8ff2f8 service nova] Acquiring lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2185e2cb-45dc-41c5-89e5-4b46bdb4168d req-22a8a28f-a831-43a7-822b-bfd46d8ff2f8 service nova] Acquired lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-2185e2cb-45dc-41c5-89e5-4b46bdb4168d req-22a8a28f-a831-43a7-822b-bfd46d8ff2f8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Refreshing network info cache for port 6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-2185e2cb-45dc-41c5-89e5-4b46bdb4168d req-22a8a28f-a831-43a7-822b-bfd46d8ff2f8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Updated VIF entry in instance network info cache for port 6609e26a-f730-45fe-b69c-f2ae2c72afc3. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-2185e2cb-45dc-41c5-89e5-4b46bdb4168d req-22a8a28f-a831-43a7-822b-bfd46d8ff2f8 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Updating instance_info_cache with network_info: [{"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2185e2cb-45dc-41c5-89e5-4b46bdb4168d req-22a8a28f-a831-43a7-822b-bfd46d8ff2f8 service nova] Releasing lock "refresh_cache-cfc0cd92-5f09-4726-85ec-102c2d6cefb1" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:08:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:15 user nova-compute[72803]: INFO nova.compute.manager [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Detaching volume 0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f
Aug 15 07:08:15 user nova-compute[72803]: INFO nova.virt.block_device [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Attempting to driver detach volume 0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f from mountpoint /dev/vdb
Aug 15 07:08:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Attempting to detach device vdb from instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:08:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:08:15 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:08:15 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:08:15 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:08:15 user nova-compute[72803]:   <serial>0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f</serial>
Aug 15 07:08:15 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:08:15 user nova-compute[72803]: </disk>
Aug 15 07:08:15 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:08:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Successfully detached device vdb from instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d from the persistent domain config.
Aug 15 07:08:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:08:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:08:15 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:08:15 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:08:15 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:08:15 user nova-compute[72803]:   <serial>0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f</serial>
Aug 15 07:08:15 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:08:15 user nova-compute[72803]: </disk>
Aug 15 07:08:15 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083296.1916935, 9c7018fa-ebd1-4446-a8ca-f775ee3a570d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:08:16 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Successfully detached device vdb from instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d from the live domain config.
Aug 15 07:08:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXHecYEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:08:16 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[affce3f2-9681-4d3b-9a0e-c4a2f4aa1e0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d6946-4e46-4fd0-b110-53a9de55e048]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:16 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:08:16 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:16 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:16 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:16 user nova-compute[72803]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f (non-flash)
Aug 15 07:08:16 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:16 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:16 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c06869e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b672b37a-0019-4f3f-87dd-a699c817d394]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab21a9-c494-488b-9672-08e2d8b5a486]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dc5bef-c88b-438f-bcf0-e6be362eb431]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0143e5-7f7d-45e1-9305-c279939d3138]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e10bc-2564-4ace-9ff8-8c4a0508c353]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eba32c-9ac3-4b2c-a554-a9aafc7a2591]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f, portal: 172.16.0.220,3260]
Aug 15 07:08:16 user nova-compute[72803]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f, portal: 172.16.0.220,3260] successful.
Aug 15 07:08:16 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aa9f9e3-27b0-4ea8-9929-8ddf05ba271f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fedca83-b747-4ac3-a814-81bbd4ded38c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] <== disconnect_volume: return (315ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG nova.objects.instance [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid cfc0cd92-5f09-4726-85ec-102c2d6cefb1 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:17 user nova-compute[72803]: INFO nova.compute.manager [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Attaching volume ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 to /dev/vdb
Aug 15 07:08:17 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083282.0654597, 506ed7b9-6081-418b-86a8-278db430893e => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:08:17 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 506ed7b9-6081-418b-86a8-278db430893e] VM Stopped (Lifecycle Event)
Aug 15 07:08:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1aad79e4-1138-476d-a061-8a6d7ad4b7b1 None None] [instance: 506ed7b9-6081-418b-86a8-278db430893e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG os_brick.utils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[844fa424-3fdf-4fbc-9ccf-96197ba5737c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab129b0c-ac38-458c-8b78-026789cac3a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b41bb6a-7f61-4414-8808-37d799b8d029]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caf6020-f94e-4e67-8c1b-6e282de6059b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:08:17 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7fec6a-9c4f-47af-9ead-8a8f79a3bfb9]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG os_brick.utils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Updating existing volume attachment record: 4a205176-74c5-43f7-98f7-3fb61e27e41b {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG nova.objects.instance [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'flavor' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61ba9b74-b006-47c8-ab9e-0306b90ba0de tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.851s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:19 user nova-compute[72803]: DEBUG nova.objects.instance [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:08:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquired lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:08:19 user nova-compute[72803]: DEBUG nova.network.neutron [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:08:19 user nova-compute[72803]: DEBUG nova.objects.instance [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'info_cache' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Releasing lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:08:20 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance destroyed successfully.
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'resources' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG os_vif [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7026c22f-40, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:08:20 user nova-compute[72803]: INFO os_vif [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40')
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Start _get_guest_xml network_info=[{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'numa_topology' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:08:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'pci_devices' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:08:20 user nova-compute[72803]:   <uuid>5170f08d-a847-4094-82b7-749797acf8b7</uuid>
Aug 15 07:08:20 user nova-compute[72803]:   <name>instance-00000012</name>
Aug 15 07:08:20 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:08:20 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:08:20 user nova-compute[72803]:   <metadata>
Aug 15 07:08:20 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:08:20 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:08:20 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeTestJSON-server-1872031898</nova:name>
Aug 15 07:08:20 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:08:20</nova:creationTime>
Aug 15 07:08:20 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:08:20 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:08:20 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:08:20 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:08:20 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:08:20 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:08:20 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:08:20 user nova-compute[72803]:       <nova:owner>
Aug 15 07:08:20 user nova-compute[72803]:         <nova:user uuid="aeef867bec97404e9bd1f9810b93ba29">tempest-AttachVolumeTestJSON-820469847-project-member</nova:user>
Aug 15 07:08:20 user nova-compute[72803]:         <nova:project uuid="faa20f14f0f14b6791cce17d3fec420d">tempest-AttachVolumeTestJSON-820469847</nova:project>
Aug 15 07:08:20 user nova-compute[72803]:       </nova:owner>
Aug 15 07:08:20 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:08:20 user nova-compute[72803]:       <nova:ports>
Aug 15 07:08:20 user nova-compute[72803]:         <nova:port uuid="7026c22f-40fe-4665-9fb8-5d116dfe7513">
Aug 15 07:08:20 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 07:08:20 user nova-compute[72803]:         </nova:port>
Aug 15 07:08:20 user nova-compute[72803]:       </nova:ports>
Aug 15 07:08:20 user nova-compute[72803]:     </nova:instance>
Aug 15 07:08:20 user nova-compute[72803]:   </metadata>
Aug 15 07:08:20 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:08:20 user nova-compute[72803]:     <system>
Aug 15 07:08:20 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:08:20 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:08:20 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:08:20 user nova-compute[72803]:       <entry name="serial">5170f08d-a847-4094-82b7-749797acf8b7</entry>
Aug 15 07:08:20 user nova-compute[72803]:       <entry name="uuid">5170f08d-a847-4094-82b7-749797acf8b7</entry>
Aug 15 07:08:20 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:08:20 user nova-compute[72803]:     </system>
Aug 15 07:08:20 user nova-compute[72803]:   </sysinfo>
Aug 15 07:08:20 user nova-compute[72803]:   <os>
Aug 15 07:08:20 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:08:20 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:08:20 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:08:20 user nova-compute[72803]:   </os>
Aug 15 07:08:20 user nova-compute[72803]:   <features>
Aug 15 07:08:20 user nova-compute[72803]:     <acpi/>
Aug 15 07:08:20 user nova-compute[72803]:     <apic/>
Aug 15 07:08:20 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:08:20 user nova-compute[72803]:   </features>
Aug 15 07:08:20 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:08:20 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:08:20 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:08:20 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:08:20 user nova-compute[72803]:   </clock>
Aug 15 07:08:20 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:08:20 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:08:20 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:08:20 user nova-compute[72803]:   </cpu>
Aug 15 07:08:20 user nova-compute[72803]:   <devices>
Aug 15 07:08:20 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:08:20 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:08:20 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk"/>
Aug 15 07:08:20 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:08:20 user nova-compute[72803]:     </disk>
Aug 15 07:08:20 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:08:20 user nova-compute[72803]:       <mac address="fa:16:3e:b8:f9:8b"/>
Aug 15 07:08:20 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:08:20 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:08:20 user nova-compute[72803]:       <target dev="tap7026c22f-40"/>
Aug 15 07:08:20 user nova-compute[72803]:     </interface>
Aug 15 07:08:20 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:08:20 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/console.log" append="off"/>
Aug 15 07:08:20 user nova-compute[72803]:     </serial>
Aug 15 07:08:20 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:08:20 user nova-compute[72803]:     <video>
Aug 15 07:08:20 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:08:20 user nova-compute[72803]:     </video>
Aug 15 07:08:20 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:08:20 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:08:20 user nova-compute[72803]:     </rng>
Aug 15 07:08:20 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:08:20 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:08:20 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:08:20 user nova-compute[72803]:     </memballoon>
Aug 15 07:08:20 user nova-compute[72803]:   </devices>
Aug 15 07:08:20 user nova-compute[72803]: </domain>
Aug 15 07:08:20 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:08:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Cannot resize image /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'migration_context' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG os_vif [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7026c22f-40, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7026c22f-40, col_values=(('external_ids', {'iface-id': '7026c22f-40fe-4665-9fb8-5d116dfe7513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:f9:8b', 'vm-uuid': '5170f08d-a847-4094-82b7-749797acf8b7'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:08:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:21 user nova-compute[72803]: INFO os_vif [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40')
Aug 15 07:08:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-b21ffe06-b68e-4216-bc46-093dad6690d5 req-b0d777bb-1ea3-40c0-a908-6071bbcb3d38 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b21ffe06-b68e-4216-bc46-093dad6690d5 req-b0d777bb-1ea3-40c0-a908-6071bbcb3d38 service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b21ffe06-b68e-4216-bc46-093dad6690d5 req-b0d777bb-1ea3-40c0-a908-6071bbcb3d38 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b21ffe06-b68e-4216-bc46-093dad6690d5 req-b0d777bb-1ea3-40c0-a908-6071bbcb3d38 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-b21ffe06-b68e-4216-bc46-093dad6690d5 req-b0d777bb-1ea3-40c0-a908-6071bbcb3d38 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:22 user nova-compute[72803]: WARNING nova.compute.manager [req-b21ffe06-b68e-4216-bc46-093dad6690d5 req-b0d777bb-1ea3-40c0-a908-6071bbcb3d38 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state stopped and task_state powering-on.
Aug 15 07:08:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:24 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083304.9901319, 5170f08d-a847-4094-82b7-749797acf8b7 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:08:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Resumed (Lifecycle Event)
Aug 15 07:08:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:08:25 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance rebooted successfully.
Aug 15 07:08:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-25fd88d7-d704-477a-b11d-3d80cce4888e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:08:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-7d424312-5d9a-43f2-b491-2ffd6f95f215 req-5e644613-c745-4838-a04c-0a6713c8ae08 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7d424312-5d9a-43f2-b491-2ffd6f95f215 req-5e644613-c745-4838-a04c-0a6713c8ae08 service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7d424312-5d9a-43f2-b491-2ffd6f95f215 req-5e644613-c745-4838-a04c-0a6713c8ae08 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7d424312-5d9a-43f2-b491-2ffd6f95f215 req-5e644613-c745-4838-a04c-0a6713c8ae08 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-7d424312-5d9a-43f2-b491-2ffd6f95f215 req-5e644613-c745-4838-a04c-0a6713c8ae08 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:25 user nova-compute[72803]: WARNING nova.compute.manager [req-7d424312-5d9a-43f2-b491-2ffd6f95f215 req-5e644613-c745-4838-a04c-0a6713c8ae08 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state stopped and task_state powering-on.
Aug 15 07:08:25 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 07:08:25 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083304.9916158, 5170f08d-a847-4094-82b7-749797acf8b7 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:08:25 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Started (Lifecycle Event)
Aug 15 07:08:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:08:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJdTZQIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:08:27 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:08:27 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:08:27 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c33d1f-c09a-4b3b-84a3-bc9b97d8d4a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:08:27 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc84433-0a6e-45d7-b02a-ad7e045fdf82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0] added
Aug 15 07:08:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b2dd0-e207-493e-86e2-6aacfdf3f7ce]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b857d8-a28e-4c22-ba38-e29094ebdf40]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJdTZQIL {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJdTZQIL" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6ca3fb-4de5-4a34-99d8-714de646993b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fJdTZQIL'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.068s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd8b1b5-5900-4e79-abea-19262fc3264a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8a6006-192b-4018-b060-cccd6ac7d85e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61cc025-9521-4e46-9d40-a00753cfa773]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0, portal: 172.16.0.220,3260]
Aug 15 07:08:28 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0, portal: 172.16.0.220,3260] successful.
Aug 15 07:08:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d277756b-4a49-4383-a7f4-ab520a262d12]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a9ec7d-7b17-4c46-aa52-31bab135df5e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:28 user nova-compute[72803]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 (non-flash)
Aug 15 07:08:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc71e9b-6610-4d94-a47f-949c7dd64f80]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJdTZQIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23061653361303032', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061653361303032', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG nova.objects.instance [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid cfc0cd92-5f09-4726-85ec-102c2d6cefb1 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:08:29 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:08:29 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:08:29 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:08:29 user nova-compute[72803]:   <serial>ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0</serial>
Aug 15 07:08:29 user nova-compute[72803]: </disk>
Aug 15 07:08:29 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] No VIF found with MAC fa:16:3e:96:b1:42, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:08:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-17b5287f-30d5-47f4-88af-44b9298d8db3 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.824s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:31 user nova-compute[72803]: INFO nova.compute.manager [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Detaching volume ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0
Aug 15 07:08:31 user nova-compute[72803]: INFO nova.virt.block_device [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Attempting to driver detach volume ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 from mountpoint /dev/vdb
Aug 15 07:08:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Attempting to detach device vdb from instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:08:31 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:08:31 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:08:31 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:08:31 user nova-compute[72803]:   <serial>ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0</serial>
Aug 15 07:08:31 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:08:31 user nova-compute[72803]: </disk>
Aug 15 07:08:31 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:08:31 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully detached device vdb from instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 from the persistent domain config.
Aug 15 07:08:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:08:31 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:08:31 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:08:31 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:08:31 user nova-compute[72803]:   <serial>ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0</serial>
Aug 15 07:08:31 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:08:31 user nova-compute[72803]: </disk>
Aug 15 07:08:31 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083311.8448505, cfc0cd92-5f09-4726-85ec-102c2d6cefb1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:08:31 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully detached device vdb from instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 from the live domain config.
Aug 15 07:08:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJdTZQIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:08:31 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[662eb58d-c876-4e6a-ac30-60300fef3d58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5411179c-87fb-4f23-909b-696eabb6c9dc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:31 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:31 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:31 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:31 user nova-compute[72803]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 (non-flash)
Aug 15 07:08:31 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:31 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:31 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:31 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:31 user nova-compute[72803]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 (non-flash)
Aug 15 07:08:31 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f350c91e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d337f68-9fb0-45f4-97db-1e21558a3f1b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d75cd17-9133-446e-aead-799d83306b20]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[33366cce-17b9-4aae-a999-1107edd9ab5e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:08:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6566f7d-1dd2-480a-8935-5696ce1b9d45]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b87cd0a-960c-427e-bb27-eda3141dd874]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a0c30e-0bb1-4632-b13e-360007934d71]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0, portal: 172.16.0.220,3260]
Aug 15 07:08:32 user nova-compute[72803]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0, portal: 172.16.0.220,3260] successful.
Aug 15 07:08:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7dd7bd-a7ba-4c78-89fa-1419fef9e5f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[928b717a-81a5-41f5-9ab7-11e749d9902e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] <== disconnect_volume: return (307ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:08:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:08:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'flavor' on Instance uuid cfc0cd92-5f09-4726-85ec-102c2d6cefb1 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-02eddd5c-3f17-4a0c-be12-29c75e14fca5 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.800s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:08:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:08:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:08:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:08:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:08:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updating instance_info_cache with network_info: [{"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-a4a01678-2255-4fb5-a497-1ceaab81422a" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:08:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:08:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:45 user nova-compute[72803]: INFO nova.compute.manager [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Terminating instance
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-aa9420cf-bc17-474f-8b28-89cbcd515c8d req-343cf94b-1273-4030-8708-15627f2c6776 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-unplugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aa9420cf-bc17-474f-8b28-89cbcd515c8d req-343cf94b-1273-4030-8708-15627f2c6776 service nova] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aa9420cf-bc17-474f-8b28-89cbcd515c8d req-343cf94b-1273-4030-8708-15627f2c6776 service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-aa9420cf-bc17-474f-8b28-89cbcd515c8d req-343cf94b-1273-4030-8708-15627f2c6776 service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-aa9420cf-bc17-474f-8b28-89cbcd515c8d req-343cf94b-1273-4030-8708-15627f2c6776 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] No waiting events found dispatching network-vif-unplugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-aa9420cf-bc17-474f-8b28-89cbcd515c8d req-343cf94b-1273-4030-8708-15627f2c6776 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-unplugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:45 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Instance destroyed successfully.
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.objects.instance [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lazy-loading 'resources' on Instance uuid 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1958541110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1958541110',id=23,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv0b0a3ngqM1Rw6ivElDPxaHZTqoncXJY7HEghPOJHNLnPbdeaVX6ny+VQEQQqKJjEj171XZaFPBboIGN/GYnEdB2Fl2X0k60YoU4I4StHZ2sd7s/Pu8YkH906fueCb3w==',key_name='tempest-keypair-312287039',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:07:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7937188c3cb441fa4f4348d2e3b2573',ramdisk_id='',reservation_id='r-nt0tdef8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-758519316',owner_user_name='tempest-AttachVolumeShelveTestJSON-758519316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35a29bfde8d746f9b15c12e31a925c47',uuid=56b3f17c-680b-4cbc-ad5a-26ec9f4ee154,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converting VIF {"id": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "address": "fa:16:3e:ae:4f:86", "network": {"id": "496c14f6-6cf6-4b91-a697-1bccce12a949", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-469435129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7937188c3cb441fa4f4348d2e3b2573", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390036c0-19", "ovs_interfaceid": "390036c0-19a4-46bf-9e26-a90cdb1e2333", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG os_vif [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap390036c0-19, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:08:46 user nova-compute[72803]: INFO os_vif [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:86,bridge_name='br-int',has_traffic_filtering=True,id=390036c0-19a4-46bf-9e26-a90cdb1e2333,network=Network(496c14f6-6cf6-4b91-a697-1bccce12a949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390036c0-19')
Aug 15 07:08:46 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Deleting instance files /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154_del
Aug 15 07:08:46 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Deletion of /opt/stack/data/nova/instances/56b3f17c-680b-4cbc-ad5a-26ec9f4ee154_del complete
Aug 15 07:08:46 user nova-compute[72803]: INFO nova.compute.manager [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:46 user nova-compute[72803]: INFO nova.compute.manager [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Rescuing
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquired lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG nova.network.neutron [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:46 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '56b3f17c-680b-4cbc-ad5a-26ec9f4ee154' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '56b3f17c-680b-4cbc-ad5a-26ec9f4ee154' (instance-00000017)
Aug 15 07:08:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG nova.network.neutron [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Updating instance_info_cache with network_info: [{"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Releasing lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c22ab82-06de-415e-bb08-6eb150dd9918 req-9e8a6b8b-0cf2-4aea-ab98-5a440f6dc39b service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c22ab82-06de-415e-bb08-6eb150dd9918 req-9e8a6b8b-0cf2-4aea-ab98-5a440f6dc39b service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c22ab82-06de-415e-bb08-6eb150dd9918 req-9e8a6b8b-0cf2-4aea-ab98-5a440f6dc39b service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c22ab82-06de-415e-bb08-6eb150dd9918 req-9e8a6b8b-0cf2-4aea-ab98-5a440f6dc39b service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c22ab82-06de-415e-bb08-6eb150dd9918 req-9e8a6b8b-0cf2-4aea-ab98-5a440f6dc39b service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:47 user nova-compute[72803]: WARNING nova.compute.manager [req-4c22ab82-06de-415e-bb08-6eb150dd9918 req-9e8a6b8b-0cf2-4aea-ab98-5a440f6dc39b service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state active and task_state rescuing.
Aug 15 07:08:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:47 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Took 1.17 seconds to deallocate network for instance.
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-f874702c-c917-4365-89d8-45205b5b681b req-e15be922-3e5f-42f4-9913-4052374c3eb1 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f874702c-c917-4365-89d8-45205b5b681b req-e15be922-3e5f-42f4-9913-4052374c3eb1 service nova] Acquiring lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f874702c-c917-4365-89d8-45205b5b681b req-e15be922-3e5f-42f4-9913-4052374c3eb1 service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f874702c-c917-4365-89d8-45205b5b681b req-e15be922-3e5f-42f4-9913-4052374c3eb1 service nova] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-f874702c-c917-4365-89d8-45205b5b681b req-e15be922-3e5f-42f4-9913-4052374c3eb1 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] No waiting events found dispatching network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:47 user nova-compute[72803]: WARNING nova.compute.manager [req-f874702c-c917-4365-89d8-45205b5b681b req-e15be922-3e5f-42f4-9913-4052374c3eb1 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received unexpected event network-vif-plugged-390036c0-19a4-46bf-9e26-a90cdb1e2333 for instance with vm_state deleted and task_state None.
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-f874702c-c917-4365-89d8-45205b5b681b req-e15be922-3e5f-42f4-9913-4052374c3eb1 service nova] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Received event network-vif-deleted-390036c0-19a4-46bf-9e26-a90cdb1e2333 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:47 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance destroyed successfully.
Aug 15 07:08:47 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Attempting a stable device rescue
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72803) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance directory exists: not creating {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 07:08:47 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Creating image(s)
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "/opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "/opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "/opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.objects.instance [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'trusted_certs' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "a366d16291cdedee99a57aa947baa20682c9ddc2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a366d16291cdedee99a57aa947baa20682c9ddc2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:08:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:48 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Deleted allocations for instance 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154
Aug 15 07:08:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 1.108s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-69e66567-616c-4ad5-a41e-330523bb8080 req-0b8c643f-9f00-47af-923f-8d322f35d4b0 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-69e66567-616c-4ad5-a41e-330523bb8080 req-0b8c643f-9f00-47af-923f-8d322f35d4b0 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-69e66567-616c-4ad5-a41e-330523bb8080 req-0b8c643f-9f00-47af-923f-8d322f35d4b0 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-69e66567-616c-4ad5-a41e-330523bb8080 req-0b8c643f-9f00-47af-923f-8d322f35d4b0 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-69e66567-616c-4ad5-a41e-330523bb8080 req-0b8c643f-9f00-47af-923f-8d322f35d4b0 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:49 user nova-compute[72803]: WARNING nova.compute.manager [req-69e66567-616c-4ad5-a41e-330523bb8080 req-0b8c643f-9f00-47af-923f-8d322f35d4b0 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state active and task_state rescuing.
Aug 15 07:08:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2.part --force-share --output=json" returned: 0 in 0.568s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.virt.images [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] 4aa85810-e722-4d03-b659-0e2082b80b5c was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2.part /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-96db42f9-bf05-4989-a1d4-713a705cf443 tempest-AttachVolumeShelveTestJSON-758519316 tempest-AttachVolumeShelveTestJSON-758519316-project-member] Lock "56b3f17c-680b-4cbc-ad5a-26ec9f4ee154" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.364s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:49 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:08:49 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7038MB free_disk=25.257431030273438GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Applying migration context for instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 as it has an incoming, in-progress migration 486cc2fb-4672-45ba-aa57-40b6786f152b. Migration status is finished {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 07:08:49 user nova-compute[72803]: INFO nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating resource usage from migration 486cc2fb-4672-45ba-aa57-40b6786f152b
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 549d5d40-8521-4a9b-abbd-f6319b5b393b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Migration 486cc2fb-4672-45ba-aa57-40b6786f152b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 6e24f20a-5872-4b4b-bbad-0528fe4ec73b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:08:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2.part /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2.converted" returned: 0 in 0.655s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a366d16291cdedee99a57aa947baa20682c9ddc2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.454s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "a366d16291cdedee99a57aa947baa20682c9ddc2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a366d16291cdedee99a57aa947baa20682c9ddc2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2 --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2,backing_fmt=raw /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.rescue {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2,backing_fmt=raw /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.rescue" returned: 0 in 0.065s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a366d16291cdedee99a57aa947baa20682c9ddc2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'migration_context' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Start _get_guest_xml network_info=[{"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "vif_mac": "fa:16:3e:ae:41:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4aa85810-e722-4d03-b659-0e2082b80b5c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'accff008-8294-46e2-9810-70acf15c4c96', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQoitgBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '549d5d40-8521-4a9b-abbd-f6319b5b393b', 'attached_at': '', 'detached_at': '', 'volume_id': '65a376f5-1916-4ba2-a54e-da440b48eb1b', 'serial': '65a376f5-1916-4ba2-a54e-da440b48eb1b'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'resources' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'numa_topology' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:50 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:08:50 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'vcpu_model' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQoitgBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:08:50 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:08:50 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:08:50 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e7bf30-6de7-47e8-a460-60a2f3d554cd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cQoitgBV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 07:08:50 user nova-compute[72803]: node.name = iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b
Aug 15 07:08:50 user nova-compute[72803]: node.tpgt = -1
Aug 15 07:08:50 user nova-compute[72803]: node.startup = automatic
Aug 15 07:08:50 user nova-compute[72803]: node.leading_login = No
Aug 15 07:08:50 user nova-compute[72803]: iface.iscsi_ifacename = default
Aug 15 07:08:50 user nova-compute[72803]: iface.net_ifacename = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.ipaddress = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.prefix_len = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.hwaddress = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.transport_name = tcp
Aug 15 07:08:50 user nova-compute[72803]: iface.initiatorname = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.state = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.vlan_id = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.vlan_priority = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.vlan_state = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.iface_num = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.mtu = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.port = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.bootproto = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.subnet_mask = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.gateway = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.dhcp_alt_client_id = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.dhcp_dns = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.dhcp_learn_iqn = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.dhcp_vendor_id_state = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.dhcp_vendor_id = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.dhcp_slp_da = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.fragmentation = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.gratuitous_arp = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.incoming_forwarding = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.tos_state = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.tos = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.ttl = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.delayed_ack = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.tcp_nagle = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.tcp_wsf_state = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.tcp_wsf = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.tcp_timer_scale = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.tcp_timestamp = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.redirect = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.def_task_mgmt_timeout = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.header_digest = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.data_digest = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.immediate_data = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.initial_r2t = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.data_seq_inorder = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.data_pdu_inorder = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.erl = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.max_receive_data_len = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.first_burst_len = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.max_outstanding_r2t = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.max_burst_len = 0
Aug 15 07:08:50 user nova-compute[72803]: iface.chap_auth = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.bidi_chap = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.strict_login_compliance = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.discovery_auth = <empty>
Aug 15 07:08:50 user nova-compute[72803]: iface.discovery_logout = <empty>
Aug 15 07:08:50 user nova-compute[72803]: node.discovery_address = <empty>
Aug 15 07:08:50 user nova-compute[72803]: node.discovery_port = 0
Aug 15 07:08:50 user nova-compute[72803]: node.discovery_type = static
Aug 15 07:08:50 user nova-compute[72803]: node.session.initial_cmdsn = 0
Aug 15 07:08:50 user nova-compute[72803]: node.session.initial_login_retry_max = 8
Aug 15 07:08:50 user nova-compute[72803]: node.session.xmit_thread_priority = -20
Aug 15 07:08:50 user nova-compute[72803]: node.session.cmds_max = 128
Aug 15 07:08:50 user nova-compute[72803]: node.session.queue_depth = 32
Aug 15 07:08:50 user nova-compute[72803]: node.session.nr_sessions = 1
Aug 15 07:08:50 user nova-compute[72803]: node.session.auth.authmethod = CHAP
Aug 15 07:08:50 user nova-compute[72803]: node.session.auth.username = cQoitgBV
Aug 15 07:08:50 user nova-compute[72803]: node.session.auth.password = ***
Aug 15 07:08:50 user nova-compute[72803]: node.session.auth.username_in = <empty>
Aug 15 07:08:50 user nova-compute[72803]: node.session.auth.password_in = <empty>
Aug 15 07:08:50 user nova-compute[72803]: node.session.auth.chap_algs = MD5
Aug 15 07:08:50 user nova-compute[72803]: node.session.timeo.replacement_timeout = 120
Aug 15 07:08:50 user nova-compute[72803]: node.session.err_timeo.abort_timeout = 15
Aug 15 07:08:50 user nova-compute[72803]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 07:08:50 user nova-compute[72803]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 07:08:50 user nova-compute[72803]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.FastAbort = Yes
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.InitialR2T = No
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.ImmediateData = Yes
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.MaxConnections = 1
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 07:08:50 user nova-compute[72803]: node.session.iscsi.ERL = 0
Aug 15 07:08:50 user nova-compute[72803]: node.session.scan = manual
Aug 15 07:08:50 user nova-compute[72803]: node.session.reopen_max = 0
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].address = 172.16.0.220
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].port = 3260
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].startup = manual
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].tcp.window_size = 524288
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].tcp.type_of_service = 0
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].timeo.logout_timeout = 15
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].timeo.login_timeout = 15
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].timeo.auth_timeout = 45
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].iscsi.DataDigest = None
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].iscsi.IFMarker = No
Aug 15 07:08:50 user nova-compute[72803]: node.conn[0].iscsi.OFMarker = No
Aug 15 07:08:50 user nova-compute[72803]: # END RECORD
Aug 15 07:08:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[14426d38-a573-46bf-afb6-bb85171b3e8f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[be909155-4f81-48d7-8c54-dd84a1d413ad]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQoitgBV {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQoitgBV" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e73b8e-0bdc-44c3-a71d-44fcc8d11d1d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQoitgBV'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab45a2b8-ed22-40d0-b5cb-5e99d5813297]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6512d7-b7e0-4bd0-8b99-fd5f517f0578]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:50 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:50 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:50 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:50 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:50 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:50 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:50 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef6d7af-6805-4c3c-b2d3-8ecf41f2a9de]: (4, ('0 0 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQoitgBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.210s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] <== connect_volume: return (212ms) {'type': 'block', 'scsi_wwn': '26637393166633633', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637393166633633', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322158826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322158826',id=29,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:07:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-n98lymqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:07:25Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=549d5d40-8521-4a9b-abbd-f6319b5b393b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "vif_mac": "fa:16:3e:ae:41:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "vif_mac": "fa:16:3e:ae:41:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:41:07,bridge_name='br-int',has_traffic_filtering=True,id=7f5ebbd1-04cb-44df-a1a0-fe9979075501,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5ebbd1-04') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'pci_devices' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:08:50 user nova-compute[72803]:   <uuid>549d5d40-8521-4a9b-abbd-f6319b5b393b</uuid>
Aug 15 07:08:50 user nova-compute[72803]:   <name>instance-0000001d</name>
Aug 15 07:08:50 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:08:50 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:08:50 user nova-compute[72803]:   <metadata>
Aug 15 07:08:50 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:08:50 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:08:50 user nova-compute[72803]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1322158826</nova:name>
Aug 15 07:08:50 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:08:50</nova:creationTime>
Aug 15 07:08:50 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:08:50 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:08:50 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:08:50 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:08:50 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:08:50 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:08:50 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:08:50 user nova-compute[72803]:       <nova:owner>
Aug 15 07:08:50 user nova-compute[72803]:         <nova:user uuid="bc7ee5090ba54d4b8acbd4c9f84835f3">tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member</nova:user>
Aug 15 07:08:50 user nova-compute[72803]:         <nova:project uuid="07ede5bd5cb24059bc4a185badef865d">tempest-ServerBootFromVolumeStableRescueTest-1860507335</nova:project>
Aug 15 07:08:50 user nova-compute[72803]:       </nova:owner>
Aug 15 07:08:50 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:08:50 user nova-compute[72803]:       <nova:ports>
Aug 15 07:08:50 user nova-compute[72803]:         <nova:port uuid="7f5ebbd1-04cb-44df-a1a0-fe9979075501">
Aug 15 07:08:50 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 07:08:50 user nova-compute[72803]:         </nova:port>
Aug 15 07:08:50 user nova-compute[72803]:       </nova:ports>
Aug 15 07:08:50 user nova-compute[72803]:     </nova:instance>
Aug 15 07:08:50 user nova-compute[72803]:   </metadata>
Aug 15 07:08:50 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:08:50 user nova-compute[72803]:     <system>
Aug 15 07:08:50 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:08:50 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:08:50 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:08:50 user nova-compute[72803]:       <entry name="serial">549d5d40-8521-4a9b-abbd-f6319b5b393b</entry>
Aug 15 07:08:50 user nova-compute[72803]:       <entry name="uuid">549d5d40-8521-4a9b-abbd-f6319b5b393b</entry>
Aug 15 07:08:50 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:08:50 user nova-compute[72803]:     </system>
Aug 15 07:08:50 user nova-compute[72803]:   </sysinfo>
Aug 15 07:08:50 user nova-compute[72803]:   <os>
Aug 15 07:08:50 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:08:50 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:08:50 user nova-compute[72803]:   </os>
Aug 15 07:08:50 user nova-compute[72803]:   <features>
Aug 15 07:08:50 user nova-compute[72803]:     <acpi/>
Aug 15 07:08:50 user nova-compute[72803]:     <apic/>
Aug 15 07:08:50 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:08:50 user nova-compute[72803]:   </features>
Aug 15 07:08:50 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:08:50 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:08:50 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:08:50 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:08:50 user nova-compute[72803]:   </clock>
Aug 15 07:08:50 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:08:50 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:08:50 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:08:50 user nova-compute[72803]:   </cpu>
Aug 15 07:08:50 user nova-compute[72803]:   <devices>
Aug 15 07:08:50 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:08:50 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:08:50 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 07:08:50 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:08:50 user nova-compute[72803]:       <serial>65a376f5-1916-4ba2-a54e-da440b48eb1b</serial>
Aug 15 07:08:50 user nova-compute[72803]:     </disk>
Aug 15 07:08:50 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:08:50 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:08:50 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.rescue"/>
Aug 15 07:08:50 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:08:50 user nova-compute[72803]:       <boot order="1"/>
Aug 15 07:08:50 user nova-compute[72803]:     </disk>
Aug 15 07:08:50 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:08:50 user nova-compute[72803]:       <mac address="fa:16:3e:ae:41:07"/>
Aug 15 07:08:50 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:08:50 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:08:50 user nova-compute[72803]:       <target dev="tap7f5ebbd1-04"/>
Aug 15 07:08:50 user nova-compute[72803]:     </interface>
Aug 15 07:08:50 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:08:50 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/console.log" append="off"/>
Aug 15 07:08:50 user nova-compute[72803]:     </serial>
Aug 15 07:08:50 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:08:50 user nova-compute[72803]:     <video>
Aug 15 07:08:50 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:08:50 user nova-compute[72803]:     </video>
Aug 15 07:08:50 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:08:50 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:08:50 user nova-compute[72803]:     </rng>
Aug 15 07:08:50 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:08:50 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:08:50 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:08:50 user nova-compute[72803]:     </memballoon>
Aug 15 07:08:50 user nova-compute[72803]:   </devices>
Aug 15 07:08:50 user nova-compute[72803]: </domain>
Aug 15 07:08:50 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:51 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance destroyed successfully.
Aug 15 07:08:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] No VIF found with MAC fa:16:3e:ae:41:07, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Port 89d1c280-dac6-41fa-8fb1-0d1b31c21f10 binding to destination host user is already ACTIVE {{(pid=72803) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquired lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Releasing lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Creating tmpfile /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/tmp9zqmb56u to verify with other compute node that the instance is on the same shared storage. {{(pid=72803) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 07:08:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-f2c41141-926a-4c9c-b3a7-8a5d5073852f req-ff3ecd1b-61fe-4fc6-a635-7bd7ef38841b service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2c41141-926a-4c9c-b3a7-8a5d5073852f req-ff3ecd1b-61fe-4fc6-a635-7bd7ef38841b service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2c41141-926a-4c9c-b3a7-8a5d5073852f req-ff3ecd1b-61fe-4fc6-a635-7bd7ef38841b service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2c41141-926a-4c9c-b3a7-8a5d5073852f req-ff3ecd1b-61fe-4fc6-a635-7bd7ef38841b service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-f2c41141-926a-4c9c-b3a7-8a5d5073852f req-ff3ecd1b-61fe-4fc6-a635-7bd7ef38841b service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:52 user nova-compute[72803]: WARNING nova.compute.manager [req-f2c41141-926a-4c9c-b3a7-8a5d5073852f req-ff3ecd1b-61fe-4fc6-a635-7bd7ef38841b service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state resized and task_state resize_reverting.
Aug 15 07:08:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-f4fa61f0-f0c2-4d79-87e2-9a34f681b422 req-70d36f8b-7a02-4edd-bf6a-8c1900481034 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f4fa61f0-f0c2-4d79-87e2-9a34f681b422 req-70d36f8b-7a02-4edd-bf6a-8c1900481034 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f4fa61f0-f0c2-4d79-87e2-9a34f681b422 req-70d36f8b-7a02-4edd-bf6a-8c1900481034 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f4fa61f0-f0c2-4d79-87e2-9a34f681b422 req-70d36f8b-7a02-4edd-bf6a-8c1900481034 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-f4fa61f0-f0c2-4d79-87e2-9a34f681b422 req-70d36f8b-7a02-4edd-bf6a-8c1900481034 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:52 user nova-compute[72803]: WARNING nova.compute.manager [req-f4fa61f0-f0c2-4d79-87e2-9a34f681b422 req-70d36f8b-7a02-4edd-bf6a-8c1900481034 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state active and task_state rescuing.
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:53 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance destroyed successfully.
Aug 15 07:08:53 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'resources' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:07:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_vif [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89d1c280-da, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:08:53 user nova-compute[72803]: INFO os_vif [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da')
Aug 15 07:08:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:08:53 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd41825-7a36-40cb-8e46-e6e91fec58eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28afe89-b433-4d95-86e3-5e3a90d870b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:53 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:53 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:53 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:08:53 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:08:53 user nova-compute[72803]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:08:53 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:08:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c060e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'): ({'sdf'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Removing single pathed devices sdf {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[434cf766-4241-4788-8d6b-d7b74834abad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2a8acc-2cbd-4a37-9a0a-a092da2b5abf]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flushing IO for device /dev/sdf {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4949b1b-e88d-4f23-9180-3bb5f1fe0478]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.131s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f9a800-2060-4c59-816c-63bf9411d010]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] SCSI volumes sdf have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.086s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdf7701-c5b2-4685-9560-22111bb3d199]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceb67cc-1d8d-4572-ab17-95f5ec1874d4]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]
Aug 15 07:08:53 user nova-compute[72803]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.
Aug 15 07:08:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6267a58-ec00-4557-b20e-a9031387ee23]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== disconnect_volume: return (522ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:08:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'migration_context' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-f1d9c00a-7c79-4eb2-9c54-3e5471720648 req-5892962f-1dd9-43ae-971c-83d12944d75f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f1d9c00a-7c79-4eb2-9c54-3e5471720648 req-5892962f-1dd9-43ae-971c-83d12944d75f service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f1d9c00a-7c79-4eb2-9c54-3e5471720648 req-5892962f-1dd9-43ae-971c-83d12944d75f service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f1d9c00a-7c79-4eb2-9c54-3e5471720648 req-5892962f-1dd9-43ae-971c-83d12944d75f service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-f1d9c00a-7c79-4eb2-9c54-3e5471720648 req-5892962f-1dd9-43ae-971c-83d12944d75f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:54 user nova-compute[72803]: WARNING nova.compute.manager [req-f1d9c00a-7c79-4eb2-9c54-3e5471720648 req-5892962f-1dd9-43ae-971c-83d12944d75f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state resized and task_state resize_reverting.
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-b18c124e-2876-450a-a355-9967a9387511 req-fb917d96-b3e3-44f9-9b83-3c0c2fe6bc20 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b18c124e-2876-450a-a355-9967a9387511 req-fb917d96-b3e3-44f9-9b83-3c0c2fe6bc20 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b18c124e-2876-450a-a355-9967a9387511 req-fb917d96-b3e3-44f9-9b83-3c0c2fe6bc20 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b18c124e-2876-450a-a355-9967a9387511 req-fb917d96-b3e3-44f9-9b83-3c0c2fe6bc20 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-b18c124e-2876-450a-a355-9967a9387511 req-fb917d96-b3e3-44f9-9b83-3c0c2fe6bc20 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:08:54 user nova-compute[72803]: WARNING nova.compute.manager [req-b18c124e-2876-450a-a355-9967a9387511 req-fb917d96-b3e3-44f9-9b83-3c0c2fe6bc20 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state active and task_state rescuing.
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 549d5d40-8521-4a9b-abbd-f6319b5b393b due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083334.914765, 549d5d40-8521-4a9b-abbd-f6319b5b393b => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:08:54 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] VM Resumed (Lifecycle Event)
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-dac8e6f4-a9d9-4158-b862-b99dd799bdac tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:08:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.447s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:08:54 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 07:08:54 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083334.9151735, 549d5d40-8521-4a9b-abbd-f6319b5b393b => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:08:54 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] VM Started (Lifecycle Event)
Aug 15 07:08:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:08:55 user nova-compute[72803]: INFO nova.compute.manager [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Swapping old allocation on dict_keys(['6051aed2-f8f0-45e9-ae6c-41afa9d24b7c']) held by migration 486cc2fb-4672-45ba-aa57-40b6786f152b for instance
Aug 15 07:08:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Overwriting current allocation {'allocations': {'6051aed2-f8f0-45e9-ae6c-41afa9d24b7c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 38}}, 'project_id': '3de2e755df9744d59e93c26feeec4ebf', 'user_id': '701c79552e3044d0babde5510a994efa', 'consumer_generation': 1} on consumer ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquired lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Releasing lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG os_brick.utils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[25152812-9a48-4995-8624-4041749ffb4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef5c442-4a64-4c25-972f-05a5df56986f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3333bc-937e-4825-ae17-e644b94d6fa2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[37487adb-cde5-4f1e-a5d6-d7989ec993dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:08:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:08:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:08:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:08:56 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:08:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b14f8-45d1-4f0c-b536-441c9d9f339e]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:08:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:08:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:08:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:08:56 user nova-compute[72803]: DEBUG os_brick.utils [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:08:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:08:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:00 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083325.9232645, 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:00 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] VM Stopped (Lifecycle Event)
Aug 15 07:09:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-52643331-a432-489b-979b-4ae5eaa4fae4 None None] [instance: 56b3f17c-680b-4cbc-ad5a-26ec9f4ee154] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Starting finish_revert_migration {{(pid=72803) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Start _get_guest_xml network_info=[{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '0b4b992c-bf70-4f51-8474-6af1d07490f2', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ae246e06-40b2-4c05-a7b7-63f016a8ea03', 'attached_at': '2023-08-15T07:09:06.000000', 'detached_at': '', 'volume_id': 'b3b23c9e-adc1-4800-bf40-740385364765', 'serial': 'b3b23c9e-adc1-4800-bf40-740385364765'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:09:06 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:09:06 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:09:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:09:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:09:06 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[be54feb9-9c0d-4751-9b23-ac608e0565f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:09:06 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c0fd3d-651b-4aa9-9be1-4dec67388858]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765] added
Aug 15 07:09:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[604cfe2d-c752-455d-b216-6569c5e6d344]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc70777-f37c-479b-b991-a1514ef15bfc]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:06 user nova-compute[72803]: INFO nova.compute.manager [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Terminating instance
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmoIOEMV {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmoIOEMV" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[68daa6fc-7f1e-4911-af91-de320af1e546]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmoIOEMV'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d70223-6fdc-4210-b298-265645747cfa]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[578d0083-bc47-4cf8-a18a-bc5dbd9cce4a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd6c3e9-8b9e-47c5-ade2-d5677ce9e954]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]
Aug 15 07:09:06 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.
Aug 15 07:09:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcdd01e-1223-4184-a899-2b4223c1e4ca]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ebcf25-d008-4980-a148-4a8029a41cd9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:06 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb396df2-a88a-40f5-aecb-d99e39208cd5]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f33dc09-971f-4fc7-9fc7-26b4d6f57943 req-e11b89ab-f3c7-488c-b465-6664fe845e8e service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received event network-vif-unplugged-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f33dc09-971f-4fc7-9fc7-26b4d6f57943 req-e11b89ab-f3c7-488c-b465-6664fe845e8e service nova] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f33dc09-971f-4fc7-9fc7-26b4d6f57943 req-e11b89ab-f3c7-488c-b465-6664fe845e8e service nova] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f33dc09-971f-4fc7-9fc7-26b4d6f57943 req-e11b89ab-f3c7-488c-b465-6664fe845e8e service nova] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f33dc09-971f-4fc7-9fc7-26b4d6f57943 req-e11b89ab-f3c7-488c-b465-6664fe845e8e service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] No waiting events found dispatching network-vif-unplugged-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f33dc09-971f-4fc7-9fc7-26b4d6f57943 req-e11b89ab-f3c7-488c-b465-6664fe845e8e service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received event network-vif-unplugged-e478da74-bdfe-4812-b471-86d1252ee7e9 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:09:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Instance destroyed successfully.
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.objects.instance [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lazy-loading 'resources' on Instance uuid 9c7018fa-ebd1-4446-a8ca-f775ee3a570d {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1831556221',display_name='tempest-TestServerVolumeAttachmentScenario-server-1831556221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1831556221',id=27,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHZvTG+ebaAm8p7Sv9K1kYncN0VWhzEWdmNYADnuKmNj4mH/1v12Xf8h4qViplCiU7ghKeXaLg5Te4WP9GyPfnXHpYZ/3cQ52x8slG7kKhPmHN1dUN5HVMn2z9f2lBzuw==',key_name='tempest-keypair-1021243406',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:05:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da8d277cf96f40bb97e19deccb16bc4c',ramdisk_id='',reservation_id='r-n830zulp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-847255380',owner_user_name='tempest-TestServerVolumeAttachmentScenario-847255380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19a7b75860c2469b8d1f126f689a5a48',uuid=9c7018fa-ebd1-4446-a8ca-f775ee3a570d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Converting VIF {"id": "e478da74-bdfe-4812-b471-86d1252ee7e9", "address": "fa:16:3e:ee:2c:d1", "network": {"id": "1750ab6d-f5be-41dc-9e91-f68f80bb239a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-480433497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da8d277cf96f40bb97e19deccb16bc4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape478da74-bd", "ovs_interfaceid": "e478da74-bdfe-4812-b471-86d1252ee7e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:2c:d1,bridge_name='br-int',has_traffic_filtering=True,id=e478da74-bdfe-4812-b471-86d1252ee7e9,network=Network(1750ab6d-f5be-41dc-9e91-f68f80bb239a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape478da74-bd') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG os_vif [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:2c:d1,bridge_name='br-int',has_traffic_filtering=True,id=e478da74-bdfe-4812-b471-86d1252ee7e9,network=Network(1750ab6d-f5be-41dc-9e91-f68f80bb239a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape478da74-bd') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape478da74-bd, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:09:07 user nova-compute[72803]: INFO os_vif [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:2c:d1,bridge_name='br-int',has_traffic_filtering=True,id=e478da74-bdfe-4812-b471-86d1252ee7e9,network=Network(1750ab6d-f5be-41dc-9e91-f68f80bb239a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape478da74-bd')
Aug 15 07:09:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Deleting instance files /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d_del
Aug 15 07:09:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Deletion of /opt/stack/data/nova/instances/9c7018fa-ebd1-4446-a8ca-f775ee3a570d_del complete
Aug 15 07:09:07 user nova-compute[72803]: INFO nova.compute.manager [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 15 07:09:07 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23566396432616361', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566396432616361', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:09:07 user nova-compute[72803]:   <uuid>ae246e06-40b2-4c05-a7b7-63f016a8ea03</uuid>
Aug 15 07:09:07 user nova-compute[72803]:   <name>instance-00000015</name>
Aug 15 07:09:07 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:09:07 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:09:07 user nova-compute[72803]:   <metadata>
Aug 15 07:09:07 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:09:07 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:09:07 user nova-compute[72803]:       <nova:name>tempest-ServerActionsTestOtherB-server-1170662677</nova:name>
Aug 15 07:09:07 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:09:06</nova:creationTime>
Aug 15 07:09:07 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:09:07 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:09:07 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:09:07 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:09:07 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:09:07 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:09:07 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:09:07 user nova-compute[72803]:       <nova:owner>
Aug 15 07:09:07 user nova-compute[72803]:         <nova:user uuid="701c79552e3044d0babde5510a994efa">tempest-ServerActionsTestOtherB-1808789614-project-member</nova:user>
Aug 15 07:09:07 user nova-compute[72803]:         <nova:project uuid="3de2e755df9744d59e93c26feeec4ebf">tempest-ServerActionsTestOtherB-1808789614</nova:project>
Aug 15 07:09:07 user nova-compute[72803]:       </nova:owner>
Aug 15 07:09:07 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:09:07 user nova-compute[72803]:       <nova:ports>
Aug 15 07:09:07 user nova-compute[72803]:         <nova:port uuid="89d1c280-dac6-41fa-8fb1-0d1b31c21f10">
Aug 15 07:09:07 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 07:09:07 user nova-compute[72803]:         </nova:port>
Aug 15 07:09:07 user nova-compute[72803]:       </nova:ports>
Aug 15 07:09:07 user nova-compute[72803]:     </nova:instance>
Aug 15 07:09:07 user nova-compute[72803]:   </metadata>
Aug 15 07:09:07 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:09:07 user nova-compute[72803]:     <system>
Aug 15 07:09:07 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:09:07 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:09:07 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:09:07 user nova-compute[72803]:       <entry name="serial">ae246e06-40b2-4c05-a7b7-63f016a8ea03</entry>
Aug 15 07:09:07 user nova-compute[72803]:       <entry name="uuid">ae246e06-40b2-4c05-a7b7-63f016a8ea03</entry>
Aug 15 07:09:07 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:09:07 user nova-compute[72803]:     </system>
Aug 15 07:09:07 user nova-compute[72803]:   </sysinfo>
Aug 15 07:09:07 user nova-compute[72803]:   <os>
Aug 15 07:09:07 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:09:07 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:09:07 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:09:07 user nova-compute[72803]:   </os>
Aug 15 07:09:07 user nova-compute[72803]:   <features>
Aug 15 07:09:07 user nova-compute[72803]:     <acpi/>
Aug 15 07:09:07 user nova-compute[72803]:     <apic/>
Aug 15 07:09:07 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:09:07 user nova-compute[72803]:   </features>
Aug 15 07:09:07 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:09:07 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:09:07 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:09:07 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:09:07 user nova-compute[72803]:   </clock>
Aug 15 07:09:07 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:09:07 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:09:07 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:09:07 user nova-compute[72803]:   </cpu>
Aug 15 07:09:07 user nova-compute[72803]:   <devices>
Aug 15 07:09:07 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:09:07 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:09:07 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk"/>
Aug 15 07:09:07 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:09:07 user nova-compute[72803]:     </disk>
Aug 15 07:09:07 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:09:07 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:09:07 user nova-compute[72803]:       <source dev="/dev/sdc"/>
Aug 15 07:09:07 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:09:07 user nova-compute[72803]:       <serial>b3b23c9e-adc1-4800-bf40-740385364765</serial>
Aug 15 07:09:07 user nova-compute[72803]:     </disk>
Aug 15 07:09:07 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:09:07 user nova-compute[72803]:       <mac address="fa:16:3e:32:4e:18"/>
Aug 15 07:09:07 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:09:07 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:09:07 user nova-compute[72803]:       <target dev="tap89d1c280-da"/>
Aug 15 07:09:07 user nova-compute[72803]:     </interface>
Aug 15 07:09:07 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:09:07 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/console.log" append="off"/>
Aug 15 07:09:07 user nova-compute[72803]:     </serial>
Aug 15 07:09:07 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:09:07 user nova-compute[72803]:     <video>
Aug 15 07:09:07 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:09:07 user nova-compute[72803]:     </video>
Aug 15 07:09:07 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:09:07 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:09:07 user nova-compute[72803]:     </rng>
Aug 15 07:09:07 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:09:07 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:09:07 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:09:07 user nova-compute[72803]:     </memballoon>
Aug 15 07:09:07 user nova-compute[72803]:   </devices>
Aug 15 07:09:07 user nova-compute[72803]: </domain>
Aug 15 07:09:07 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG os_vif [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89d1c280-da, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89d1c280-da, col_values=(('external_ids', {'iface-id': '89d1c280-dac6-41fa-8fb1-0d1b31c21f10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:4e:18', 'vm-uuid': 'ae246e06-40b2-4c05-a7b7-63f016a8ea03'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:09:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:07 user nova-compute[72803]: INFO os_vif [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da')
Aug 15 07:09:08 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083333.020747, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:08 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Stopped (Lifecycle Event)
Aug 15 07:09:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-4c7d85eb-d589-4110-88a8-002b47acf9fa None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:08 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-4e65a1d2-396f-49ad-abba-a5e343ffed2e req-8f1a0ab4-a0e9-4096-ac8e-aeed2a415d44 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received event network-vif-deleted-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:08 user nova-compute[72803]: INFO nova.compute.manager [req-4e65a1d2-396f-49ad-abba-a5e343ffed2e req-8f1a0ab4-a0e9-4096-ac8e-aeed2a415d44 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Neutron deleted interface e478da74-bdfe-4812-b471-86d1252ee7e9; detaching it from the instance and deleting it from the info cache
Aug 15 07:09:08 user nova-compute[72803]: DEBUG nova.network.neutron [req-4e65a1d2-396f-49ad-abba-a5e343ffed2e req-8f1a0ab4-a0e9-4096-ac8e-aeed2a415d44 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:08 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Took 1.32 seconds to deallocate network for instance.
Aug 15 07:09:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-4e65a1d2-396f-49ad-abba-a5e343ffed2e req-8f1a0ab4-a0e9-4096-ac8e-aeed2a415d44 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Detach interface failed, port_id=e478da74-bdfe-4812-b471-86d1252ee7e9, reason: Instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:09:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4b1e050-e745-46d1-bfa0-f7538357aa98 req-39cb9c10-ca6e-4ffe-8707-2a9e4acfad17 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received event network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4b1e050-e745-46d1-bfa0-f7538357aa98 req-39cb9c10-ca6e-4ffe-8707-2a9e4acfad17 service nova] Acquiring lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4b1e050-e745-46d1-bfa0-f7538357aa98 req-39cb9c10-ca6e-4ffe-8707-2a9e4acfad17 service nova] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a4b1e050-e745-46d1-bfa0-f7538357aa98 req-39cb9c10-ca6e-4ffe-8707-2a9e4acfad17 service nova] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-a4b1e050-e745-46d1-bfa0-f7538357aa98 req-39cb9c10-ca6e-4ffe-8707-2a9e4acfad17 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] No waiting events found dispatching network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:08 user nova-compute[72803]: WARNING nova.compute.manager [req-a4b1e050-e745-46d1-bfa0-f7538357aa98 req-39cb9c10-ca6e-4ffe-8707-2a9e4acfad17 service nova] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Received unexpected event network-vif-plugged-e478da74-bdfe-4812-b471-86d1252ee7e9 for instance with vm_state active and task_state deleting.
Aug 15 07:09:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:09 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Deleted allocations for instance 9c7018fa-ebd1-4446-a8ca-f775ee3a570d
Aug 15 07:09:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-413fffd9-c4b5-4d20-9cb6-2eb9d8cd85dc tempest-TestServerVolumeAttachmentScenario-847255380 tempest-TestServerVolumeAttachmentScenario-847255380-project-member] Lock "9c7018fa-ebd1-4446-a8ca-f775ee3a570d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.984s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:10 user nova-compute[72803]: WARNING nova.compute.manager [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state resized and task_state resize_reverting.
Aug 15 07:09:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:10 user nova-compute[72803]: WARNING nova.compute.manager [req-e495f604-6ded-408e-b058-c9a111c21411 req-b1e1cf48-d632-4867-9576-b6bb6b1c7e5e service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state resized and task_state resize_reverting.
Aug 15 07:09:11 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083351.3837662, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Resumed (Lifecycle Event)
Aug 15 07:09:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:09:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance running successfully.
Aug 15 07:09:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] finish_revert_migration finished successfully. {{(pid=72803) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 07:09:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:09:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 07:09:11 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083351.387254, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Started (Lifecycle Event)
Aug 15 07:09:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:09:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 07:09:11 user nova-compute[72803]: INFO nova.compute.manager [None req-b4933bf7-3148-4acd-8f2a-3460fb6e5e96 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance to original state: 'active'
Aug 15 07:09:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Stashing vm_state: active {{(pid=72803) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'pci_requests' on Instance uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:09:12 user nova-compute[72803]: INFO nova.compute.claims [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Claim successful on node user
Aug 15 07:09:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'resources' on Instance uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'pci_devices' on Instance uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:12 user nova-compute[72803]: INFO nova.compute.resource_tracker [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating resource usage from migration 09bf0bf3-931c-4147-b9af-d2ca4d167826
Aug 15 07:09:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-changed-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Refreshing instance network info cache due to event network-changed-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] Acquiring lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] Acquired lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:09:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Refreshing network info cache for port d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.488s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:13 user nova-compute[72803]: INFO nova.compute.manager [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Migrating
Aug 15 07:09:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquired lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updated VIF entry in instance network info cache for port d6a1c323-0e6e-4be7-a45d-d26e3ac2d718. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] Releasing lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-changed-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Refreshing instance network info cache due to event network-changed-26906fc5-11d2-4df0-9f43-0a6df7e8de04. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] Acquiring lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating instance_info_cache with network_info: [{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Releasing lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] Acquired lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Refreshing network info cache for port 26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:09:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Starting migrate_disk_and_power_off {{(pid=72803) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updated VIF entry in instance network info cache for port 26906fc5-11d2-4df0-9f43-0a6df7e8de04. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating instance_info_cache with network_info: [{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f96b87d-85f8-4de8-ae2c-e518723bf220 req-308ad06d-2772-4129-abc6-2f29e45a5edf service nova] Releasing lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:09:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance destroyed successfully.
Aug 15 07:09:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1694780471',display_name='tempest-ServerActionsTestOtherA-server-1694780471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1694780471',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-danqw2ac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=36431f5c-df19-4836-ae18-8e9f7ae8d066,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1992696060-network", "vif_mac": "fa:16:3e:a8:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1992696060-network", "vif_mac": "fa:16:3e:a8:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_vif [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26906fc5-11, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:09:14 user nova-compute[72803]: INFO os_vif [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11')
Aug 15 07:09:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyqlsaTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:09:14 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960bedf-2050-433f-ae4f-8ab79167807d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8756cb5d-b1f7-4132-8c65-8d8e204a8916]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:14 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:14 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:14 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:14 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:14 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:14 user nova-compute[72803]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:14 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:14 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0686320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc'): ({'sde'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:09:14 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Removing single pathed devices sde {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59fb91f-a0de-426f-b09f-62c1f41365f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[78853860-f018-4e6c-a802-5d19bd1dcf5d]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flushing IO for device /dev/sde {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.034s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bcc727-a562-44b3-a600-ef37be0acf54]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-09a68b05-b3e7-4fe1-90f6-b71acb29cd36 req-edcf35ab-cce1-42fc-8f0c-9de8a8417e6a service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-unplugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09a68b05-b3e7-4fe1-90f6-b71acb29cd36 req-edcf35ab-cce1-42fc-8f0c-9de8a8417e6a service nova] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09a68b05-b3e7-4fe1-90f6-b71acb29cd36 req-edcf35ab-cce1-42fc-8f0c-9de8a8417e6a service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-09a68b05-b3e7-4fe1-90f6-b71acb29cd36 req-edcf35ab-cce1-42fc-8f0c-9de8a8417e6a service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-09a68b05-b3e7-4fe1-90f6-b71acb29cd36 req-edcf35ab-cce1-42fc-8f0c-9de8a8417e6a service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] No waiting events found dispatching network-vif-unplugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:15 user nova-compute[72803]: WARNING nova.compute.manager [req-09a68b05-b3e7-4fe1-90f6-b71acb29cd36 req-edcf35ab-cce1-42fc-8f0c-9de8a8417e6a service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received unexpected event network-vif-unplugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 for instance with vm_state active and task_state resize_migrating.
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e63dd4-d28b-4f8e-b06e-2e1475295ade]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] SCSI volumes sde have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO43177481-50cdeb6424cbd2f4', '/dev/disk/by-id/scsi-23530636465623634', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_43177481') {{(pid=84151) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0797bbd8-ae22-458e-a1f6-d78a3d090df6]: (4, None) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[22905656-9010-4690-8862-45c99c583c03]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be9bbc8-7d68-40fd-835a-0b9f31eae622]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260]
Aug 15 07:09:15 user nova-compute[72803]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260] successful.
Aug 15 07:09:15 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4540e-a243-4d5e-b8cb-3d0795516ee8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== disconnect_volume: return (368ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:09:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:09:16 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Port 26906fc5-11d2-4df0-9f43-0a6df7e8de04 binding to destination host user is already ACTIVE {{(pid=72803) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 07:09:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:09:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquired lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:09:16 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:09:16 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating instance_info_cache with network_info: [{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Releasing lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG os_brick.utils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e736c54b-6467-4d8c-8d40-bca7965a97f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2f4e1d-461c-46b9-ba65-0c2d24e50e73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ea0b76-7626-4816-8e7c-8754c6494775]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7190d9d-aa72-48db-b14e-5871b3cd81e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-8eccad76-3344-4095-904e-3ff9b4915aa9 req-89e864d4-de01-4955-b7bb-8e4cbbdbe45d service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8eccad76-3344-4095-904e-3ff9b4915aa9 req-89e864d4-de01-4955-b7bb-8e4cbbdbe45d service nova] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8eccad76-3344-4095-904e-3ff9b4915aa9 req-89e864d4-de01-4955-b7bb-8e4cbbdbe45d service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8eccad76-3344-4095-904e-3ff9b4915aa9 req-89e864d4-de01-4955-b7bb-8e4cbbdbe45d service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG nova.compute.manager [req-8eccad76-3344-4095-904e-3ff9b4915aa9 req-89e864d4-de01-4955-b7bb-8e4cbbdbe45d service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] No waiting events found dispatching network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:17 user nova-compute[72803]: WARNING nova.compute.manager [req-8eccad76-3344-4095-904e-3ff9b4915aa9 req-89e864d4-de01-4955-b7bb-8e4cbbdbe45d service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received unexpected event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 for instance with vm_state active and task_state resize_finish.
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:09:17 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:09:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[995105f1-e7fc-421d-89a2-a06e987162cb]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:09:17 user nova-compute[72803]: DEBUG os_brick.utils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:09:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:21 user nova-compute[72803]: INFO nova.compute.manager [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Terminating instance
Aug 15 07:09:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-7828d3ea-b494-425e-8004-9625a7216997 req-b7036f1d-687c-4868-8714-25c57150041d service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received event network-vif-unplugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7828d3ea-b494-425e-8004-9625a7216997 req-b7036f1d-687c-4868-8714-25c57150041d service nova] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7828d3ea-b494-425e-8004-9625a7216997 req-b7036f1d-687c-4868-8714-25c57150041d service nova] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7828d3ea-b494-425e-8004-9625a7216997 req-b7036f1d-687c-4868-8714-25c57150041d service nova] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-7828d3ea-b494-425e-8004-9625a7216997 req-b7036f1d-687c-4868-8714-25c57150041d service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] No waiting events found dispatching network-vif-unplugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-7828d3ea-b494-425e-8004-9625a7216997 req-b7036f1d-687c-4868-8714-25c57150041d service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received event network-vif-unplugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083347.3113668, 9c7018fa-ebd1-4446-a8ca-f775ee3a570d => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:22 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] VM Stopped (Lifecycle Event)
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8568cb15-dfe2-440b-a25d-0d4382a45c36 None None] [instance: 9c7018fa-ebd1-4446-a8ca-f775ee3a570d] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Instance destroyed successfully.
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.objects.instance [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lazy-loading 'resources' on Instance uuid cfc0cd92-5f09-4726-85ec-102c2d6cefb1 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2076010410',display_name='tempest-AttachVolumeNegativeTest-server-2076010410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2076010410',id=28,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOJTyTF0mLch0E2+pgJC+MZZhWACCUm1rDkRqfCbTKxjvf9xVmc6wNgvPaMDYkOM6452OiY5RJnWANSHJpOR1he4ydC3hLtmM+qFyB/eYW2kD6ywHFrOryORQqIsfYBrw==',key_name='tempest-keypair-467273894',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3743fde3d93f4fed84b52926dadc07f7',ramdisk_id='',reservation_id='r-q5lzv68p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-37766204',owner_user_name='tempest-AttachVolumeNegativeTest-37766204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50b2d95238654df88548e1549fa73210',uuid=cfc0cd92-5f09-4726-85ec-102c2d6cefb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converting VIF {"id": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "address": "fa:16:3e:96:b1:42", "network": {"id": "05b35574-99c8-41fe-a324-2bcfbc7bd111", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1077785708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3743fde3d93f4fed84b52926dadc07f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6609e26a-f7", "ovs_interfaceid": "6609e26a-f730-45fe-b69c-f2ae2c72afc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=6609e26a-f730-45fe-b69c-f2ae2c72afc3,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6609e26a-f7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG os_vif [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=6609e26a-f730-45fe-b69c-f2ae2c72afc3,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6609e26a-f7') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6609e26a-f7, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:09:22 user nova-compute[72803]: INFO os_vif [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=6609e26a-f730-45fe-b69c-f2ae2c72afc3,network=Network(05b35574-99c8-41fe-a324-2bcfbc7bd111),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6609e26a-f7')
Aug 15 07:09:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Deleting instance files /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1_del
Aug 15 07:09:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Deletion of /opt/stack/data/nova/instances/cfc0cd92-5f09-4726-85ec-102c2d6cefb1_del complete
Aug 15 07:09:22 user nova-compute[72803]: INFO nova.compute.manager [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 07:09:22 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:09:22 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:09:23 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:23 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Took 0.96 seconds to deallocate network for instance.
Aug 15 07:09:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-f3fd5fc5-d361-43ab-9ee4-eb5375a9282f req-6d25e294-be2d-4ec7-b8e3-ccaade07fd90 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received event network-vif-deleted-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:23 user nova-compute[72803]: INFO nova.compute.manager [req-f3fd5fc5-d361-43ab-9ee4-eb5375a9282f req-6d25e294-be2d-4ec7-b8e3-ccaade07fd90 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Neutron deleted interface 6609e26a-f730-45fe-b69c-f2ae2c72afc3; detaching it from the instance and deleting it from the info cache
Aug 15 07:09:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-f3fd5fc5-d361-43ab-9ee4-eb5375a9282f req-6d25e294-be2d-4ec7-b8e3-ccaade07fd90 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-f3fd5fc5-d361-43ab-9ee4-eb5375a9282f req-6d25e294-be2d-4ec7-b8e3-ccaade07fd90 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Detach interface failed, port_id=6609e26a-f730-45fe-b69c-f2ae2c72afc3, reason: Instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:09:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:23 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:09:23 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:09:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:24 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Deleted allocations for instance cfc0cd92-5f09-4726-85ec-102c2d6cefb1
Aug 15 07:09:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-818f7c00-5eb0-4156-9539-0677f01469e9 tempest-AttachVolumeNegativeTest-37766204 tempest-AttachVolumeNegativeTest-37766204-project-member] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.489s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-0dec1c93-deb2-415f-aec0-dce19395584a req-8568fb42-623f-468a-9027-5b26ab08bc71 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received event network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0dec1c93-deb2-415f-aec0-dce19395584a req-8568fb42-623f-468a-9027-5b26ab08bc71 service nova] Acquiring lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0dec1c93-deb2-415f-aec0-dce19395584a req-8568fb42-623f-468a-9027-5b26ab08bc71 service nova] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0dec1c93-deb2-415f-aec0-dce19395584a req-8568fb42-623f-468a-9027-5b26ab08bc71 service nova] Lock "cfc0cd92-5f09-4726-85ec-102c2d6cefb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-0dec1c93-deb2-415f-aec0-dce19395584a req-8568fb42-623f-468a-9027-5b26ab08bc71 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] No waiting events found dispatching network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:24 user nova-compute[72803]: WARNING nova.compute.manager [req-0dec1c93-deb2-415f-aec0-dce19395584a req-8568fb42-623f-468a-9027-5b26ab08bc71 service nova] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Received unexpected event network-vif-plugged-6609e26a-f730-45fe-b69c-f2ae2c72afc3 for instance with vm_state deleted and task_state None.
Aug 15 07:09:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Starting finish_migration {{(pid=72803) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance directory exists: not creating {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 07:09:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Creating image(s)
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Ensure instance console log exists: /opt/stack/data/nova/instances/36431f5c-df19-4836-ae18-8e9f7ae8d066/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Start _get_guest_xml network_info=[{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1992696060-network", "vif_mac": "fa:16:3e:a8:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '63a9cc42-77bd-4466-9764-cf3aae305f4b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyqlsaTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '36431f5c-df19-4836-ae18-8e9f7ae8d066', 'attached_at': '2023-08-15T07:09:28.000000', 'detached_at': '', 'volume_id': '739d0d35-77ef-4473-93c4-a7f1fe0171dc', 'serial': '739d0d35-77ef-4473-93c4-a7f1fe0171dc'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:09:27 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:09:27 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyqlsaTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:09:27 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:09:27 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:09:27 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef939d8-afd9-4909-95ef-ab932a6d74cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:09:27 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1aa971-dbbf-4b3a-b47f-c752a6a618fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc] added
Aug 15 07:09:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[febfebf1-8bf1-44f8-bdb7-211e4c64ce6d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a048cac-9bf1-4baa-87c5-48344e2c6d82]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyqlsaTU {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyqlsaTU" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b19e0-b584-4267-8f3a-318e921dec39]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uyqlsaTU'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2b1c5-f82a-4db7-ab6f-6ae0e827bc11]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[760b448c-d53d-4f95-b4aa-75afc7803165]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:27 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:27 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:27 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:27 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7359695-e36c-4688-9ecd-019c3b08592e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260]
Aug 15 07:09:27 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260] successful.
Aug 15 07:09:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[af638e1f-4c96-4929-a31d-0974aa40e49d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[041a76ee-590f-46c7-bec2-279145f883ea]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:28 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:28 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:28 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:28 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:28 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:28 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0e4cb0-b080-4eb4-95b2-64c367bb70cc]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:09:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyqlsaTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23530636465623634', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530636465623634', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1694780471',display_name='tempest-ServerActionsTestOtherA-server-1694780471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1694780471',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-danqw2ac',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:09:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=36431f5c-df19-4836-ae18-8e9f7ae8d066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1992696060-network", "vif_mac": "fa:16:3e:a8:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1992696060-network", "vif_mac": "fa:16:3e:a8:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:09:29 user nova-compute[72803]:   <uuid>36431f5c-df19-4836-ae18-8e9f7ae8d066</uuid>
Aug 15 07:09:29 user nova-compute[72803]:   <name>instance-0000001e</name>
Aug 15 07:09:29 user nova-compute[72803]:   <memory>2097152</memory>
Aug 15 07:09:29 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:09:29 user nova-compute[72803]:   <metadata>
Aug 15 07:09:29 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:09:29 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:09:29 user nova-compute[72803]:       <nova:name>tempest-ServerActionsTestOtherA-server-1694780471</nova:name>
Aug 15 07:09:29 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:09:27</nova:creationTime>
Aug 15 07:09:29 user nova-compute[72803]:       <nova:flavor name="m1.small">
Aug 15 07:09:29 user nova-compute[72803]:         <nova:memory>2048</nova:memory>
Aug 15 07:09:29 user nova-compute[72803]:         <nova:disk>20</nova:disk>
Aug 15 07:09:29 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:09:29 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:09:29 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:09:29 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:09:29 user nova-compute[72803]:       <nova:owner>
Aug 15 07:09:29 user nova-compute[72803]:         <nova:user uuid="f1e4fd69d1a64b8d80b0d1a45d62190f">tempest-ServerActionsTestOtherA-931999183-project-member</nova:user>
Aug 15 07:09:29 user nova-compute[72803]:         <nova:project uuid="ecaf763674bc4aaca9e52eda0cf41f44">tempest-ServerActionsTestOtherA-931999183</nova:project>
Aug 15 07:09:29 user nova-compute[72803]:       </nova:owner>
Aug 15 07:09:29 user nova-compute[72803]:       <nova:ports>
Aug 15 07:09:29 user nova-compute[72803]:         <nova:port uuid="26906fc5-11d2-4df0-9f43-0a6df7e8de04">
Aug 15 07:09:29 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 07:09:29 user nova-compute[72803]:         </nova:port>
Aug 15 07:09:29 user nova-compute[72803]:       </nova:ports>
Aug 15 07:09:29 user nova-compute[72803]:     </nova:instance>
Aug 15 07:09:29 user nova-compute[72803]:   </metadata>
Aug 15 07:09:29 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:09:29 user nova-compute[72803]:     <system>
Aug 15 07:09:29 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:09:29 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:09:29 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:09:29 user nova-compute[72803]:       <entry name="serial">36431f5c-df19-4836-ae18-8e9f7ae8d066</entry>
Aug 15 07:09:29 user nova-compute[72803]:       <entry name="uuid">36431f5c-df19-4836-ae18-8e9f7ae8d066</entry>
Aug 15 07:09:29 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:09:29 user nova-compute[72803]:     </system>
Aug 15 07:09:29 user nova-compute[72803]:   </sysinfo>
Aug 15 07:09:29 user nova-compute[72803]:   <os>
Aug 15 07:09:29 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:09:29 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:09:29 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:09:29 user nova-compute[72803]:   </os>
Aug 15 07:09:29 user nova-compute[72803]:   <features>
Aug 15 07:09:29 user nova-compute[72803]:     <acpi/>
Aug 15 07:09:29 user nova-compute[72803]:     <apic/>
Aug 15 07:09:29 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:09:29 user nova-compute[72803]:   </features>
Aug 15 07:09:29 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:09:29 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:09:29 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:09:29 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:09:29 user nova-compute[72803]:   </clock>
Aug 15 07:09:29 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:09:29 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:09:29 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:09:29 user nova-compute[72803]:   </cpu>
Aug 15 07:09:29 user nova-compute[72803]:   <devices>
Aug 15 07:09:29 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:09:29 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:09:29 user nova-compute[72803]:       <source dev="/dev/sdd"/>
Aug 15 07:09:29 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:09:29 user nova-compute[72803]:       <serial>739d0d35-77ef-4473-93c4-a7f1fe0171dc</serial>
Aug 15 07:09:29 user nova-compute[72803]:     </disk>
Aug 15 07:09:29 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:09:29 user nova-compute[72803]:       <mac address="fa:16:3e:a8:4c:68"/>
Aug 15 07:09:29 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:09:29 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:09:29 user nova-compute[72803]:       <target dev="tap26906fc5-11"/>
Aug 15 07:09:29 user nova-compute[72803]:     </interface>
Aug 15 07:09:29 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:09:29 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/36431f5c-df19-4836-ae18-8e9f7ae8d066/console.log" append="off"/>
Aug 15 07:09:29 user nova-compute[72803]:     </serial>
Aug 15 07:09:29 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:09:29 user nova-compute[72803]:     <video>
Aug 15 07:09:29 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:09:29 user nova-compute[72803]:     </video>
Aug 15 07:09:29 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:09:29 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:09:29 user nova-compute[72803]:     </rng>
Aug 15 07:09:29 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:09:29 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:09:29 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:09:29 user nova-compute[72803]:     </memballoon>
Aug 15 07:09:29 user nova-compute[72803]:   </devices>
Aug 15 07:09:29 user nova-compute[72803]: </domain>
Aug 15 07:09:29 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1694780471',display_name='tempest-ServerActionsTestOtherA-server-1694780471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1694780471',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-danqw2ac',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:09:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=36431f5c-df19-4836-ae18-8e9f7ae8d066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1992696060-network", "vif_mac": "fa:16:3e:a8:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1992696060-network", "vif_mac": "fa:16:3e:a8:4c:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG os_vif [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26906fc5-11, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26906fc5-11, col_values=(('external_ids', {'iface-id': '26906fc5-11d2-4df0-9f43-0a6df7e8de04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:4c:68', 'vm-uuid': '36431f5c-df19-4836-ae18-8e9f7ae8d066'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:29 user nova-compute[72803]: INFO os_vif [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11')
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] No VIF found with MAC fa:16:3e:a8:4c:68, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083354.8895516, 36431f5c-df19-4836-ae18-8e9f7ae8d066 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:29 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] VM Stopped (Lifecycle Event)
Aug 15 07:09:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-70ab9216-b73b-4182-a98e-c3985ffdec62 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-b1e7b96a-1271-4dc7-8c32-d793e2dc6027 req-a733dc61-8d9d-4beb-93f5-4ebb0bd669ac service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b1e7b96a-1271-4dc7-8c32-d793e2dc6027 req-a733dc61-8d9d-4beb-93f5-4ebb0bd669ac service nova] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b1e7b96a-1271-4dc7-8c32-d793e2dc6027 req-a733dc61-8d9d-4beb-93f5-4ebb0bd669ac service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b1e7b96a-1271-4dc7-8c32-d793e2dc6027 req-a733dc61-8d9d-4beb-93f5-4ebb0bd669ac service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-b1e7b96a-1271-4dc7-8c32-d793e2dc6027 req-a733dc61-8d9d-4beb-93f5-4ebb0bd669ac service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] No waiting events found dispatching network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:30 user nova-compute[72803]: WARNING nova.compute.manager [req-b1e7b96a-1271-4dc7-8c32-d793e2dc6027 req-a733dc61-8d9d-4beb-93f5-4ebb0bd669ac service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received unexpected event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 for instance with vm_state active and task_state resize_finish.
Aug 15 07:09:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083372.614436, 36431f5c-df19-4836-ae18-8e9f7ae8d066 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] VM Resumed (Lifecycle Event)
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:09:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance running successfully.
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Failed to set time: agent not configured {{(pid=72803) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e657cf46-102d-4aa8-97a8-ad5b657f0fc4 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] finish_migration finished successfully. {{(pid=72803) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:09:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083372.6154683, 36431f5c-df19-4836-ae18-8e9f7ae8d066 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] VM Started (Lifecycle Event)
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:09:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-f720b459-109a-45f0-bdff-21cbf6c08f5b req-34d94be3-dc85-42cc-8886-1f9e31141ba1 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f720b459-109a-45f0-bdff-21cbf6c08f5b req-34d94be3-dc85-42cc-8886-1f9e31141ba1 service nova] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f720b459-109a-45f0-bdff-21cbf6c08f5b req-34d94be3-dc85-42cc-8886-1f9e31141ba1 service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f720b459-109a-45f0-bdff-21cbf6c08f5b req-34d94be3-dc85-42cc-8886-1f9e31141ba1 service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-f720b459-109a-45f0-bdff-21cbf6c08f5b req-34d94be3-dc85-42cc-8886-1f9e31141ba1 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] No waiting events found dispatching network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:09:32 user nova-compute[72803]: WARNING nova.compute.manager [req-f720b459-109a-45f0-bdff-21cbf6c08f5b req-34d94be3-dc85-42cc-8886-1f9e31141ba1 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received unexpected event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 for instance with vm_state active and task_state resize_finish.
Aug 15 07:09:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:37 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083362.4479816, cfc0cd92-5f09-4726-85ec-102c2d6cefb1 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:09:37 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] VM Stopped (Lifecycle Event)
Aug 15 07:09:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9f1a8abf-7923-48a7-b6bf-9275ff92702f None None] [instance: cfc0cd92-5f09-4726-85ec-102c2d6cefb1] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:09:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:40 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:09:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:09:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:09:40 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:09:40 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [{"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-5170f08d-a847-4094-82b7-749797acf8b7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:09:41 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:09:41 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-a977e17c-f586-419f-bd97-161438dc7dd2 req-f1b6d8be-5928-4ba1-bbae-38b90cb5efa2 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received event network-changed-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-a977e17c-f586-419f-bd97-161438dc7dd2 req-f1b6d8be-5928-4ba1-bbae-38b90cb5efa2 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Refreshing instance network info cache due to event network-changed-b853d6f0-5d40-4009-8395-1fe7551bd84f. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a977e17c-f586-419f-bd97-161438dc7dd2 req-f1b6d8be-5928-4ba1-bbae-38b90cb5efa2 service nova] Acquiring lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a977e17c-f586-419f-bd97-161438dc7dd2 req-f1b6d8be-5928-4ba1-bbae-38b90cb5efa2 service nova] Acquired lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:09:45 user nova-compute[72803]: DEBUG nova.network.neutron [req-a977e17c-f586-419f-bd97-161438dc7dd2 req-f1b6d8be-5928-4ba1-bbae-38b90cb5efa2 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Refreshing network info cache for port b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'flavor' on Instance uuid 6e24f20a-5872-4b4b-bbad-0528fe4ec73b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:46 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Ignoring supplied device name: /dev/vdb
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:46 user nova-compute[72803]: INFO nova.compute.manager [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Attaching volume 535a4c9b-f62b-4250-8d4c-ce89a0368014 to /dev/vdb
Aug 15 07:09:46 user nova-compute[72803]: DEBUG os_brick.utils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d8af7-443c-4dcd-9479-0678b4012a54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7583321-c4f8-41a6-ba7d-84ae17501f80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de9f0b0-5ea9-45d3-bdbc-79226ea7fd81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac5ea2-87ef-4732-bf15-8128c4b37ef7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:09:46 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d4a008-a869-4a7f-8c7e-5eb8f6ba1133]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG os_brick.utils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Updating existing volume attachment record: e253f4ba-8032-432d-815f-77d013fdba8e {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG nova.network.neutron [req-a977e17c-f586-419f-bd97-161438dc7dd2 req-f1b6d8be-5928-4ba1-bbae-38b90cb5efa2 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Updated VIF entry in instance network info cache for port b853d6f0-5d40-4009-8395-1fe7551bd84f. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG nova.network.neutron [req-a977e17c-f586-419f-bd97-161438dc7dd2 req-f1b6d8be-5928-4ba1-bbae-38b90cb5efa2 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Updating instance_info_cache with network_info: [{"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a977e17c-f586-419f-bd97-161438dc7dd2 req-f1b6d8be-5928-4ba1-bbae-38b90cb5efa2 service nova] Releasing lock "refresh_cache-6e24f20a-5872-4b4b-bbad-0528fe4ec73b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:48 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:09:48 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7467MB free_disk=25.260356903076172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Applying migration context for instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 as it has an incoming, in-progress migration 09bf0bf3-931c-4147-b9af-d2ca4d167826. Migration status is finished {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 07:09:48 user nova-compute[72803]: INFO nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating resource usage from migration 09bf0bf3-931c-4147-b9af-d2ca4d167826
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 5170f08d-a847-4094-82b7-749797acf8b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 549d5d40-8521-4a9b-abbd-f6319b5b393b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 6e24f20a-5872-4b4b-bbad-0528fe4ec73b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Migration 09bf0bf3-931c-4147-b9af-d2ca4d167826 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:09:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:09:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:09:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:09:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:09:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:09:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzWOZvrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:09:56 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:09:56 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:09:56 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a13ae4f-e726-4343-a96a-d273a2b853a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:09:56 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5f671-096e-4d50-8cb7-a2151af820bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014] added
Aug 15 07:09:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4944d51-018f-4237-998e-f0437450cfae]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edd2771-d8b4-4ca4-bc2d-cd0918d96087]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzWOZvrR {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzWOZvrR" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81f73e9-238a-4e62-a5b5-efde4fff4d92]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uzWOZvrR'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a2a142-3561-457f-9e32-5b9a8ff060c7]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3520acea-b321-4956-b180-a68fc7f29237]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:56 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:56 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:56 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:56 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:56 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:56 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec561a0-6b51-4c33-9b33-44f5ea430797]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014, portal: 172.16.0.220,3260]
Aug 15 07:09:56 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014, portal: 172.16.0.220,3260] successful.
Aug 15 07:09:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ce22d-d86e-443d-be35-c46548358b4c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a284989-10d6-4abd-8a5a-3828b3282b49]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:57 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:57 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:57 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:57 user nova-compute[72803]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 (non-flash)
Aug 15 07:09:57 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:09:57 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:09:57 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:09:57 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:09:57 user nova-compute[72803]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 (non-flash)
Aug 15 07:09:57 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc59648-412a-4a19-9778-421338ba3f14]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:09:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzWOZvrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26335366566373434', 'path': '/dev/sde'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335366566373434', 'path': '/dev/sde'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'flavor' on Instance uuid 6e24f20a-5872-4b4b-bbad-0528fe4ec73b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:09:58 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:09:58 user nova-compute[72803]:   <source dev="/dev/sde"/>
Aug 15 07:09:58 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:09:58 user nova-compute[72803]:   <serial>535a4c9b-f62b-4250-8d4c-ce89a0368014</serial>
Aug 15 07:09:58 user nova-compute[72803]: </disk>
Aug 15 07:09:58 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] No VIF found with MAC fa:16:3e:d2:79:10, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:09:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cc09be73-4a60-46a5-94a8-4056322fa465 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.340s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:09:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:09:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:10 user nova-compute[72803]: INFO nova.compute.manager [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Terminating instance
Aug 15 07:10:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-a07a28f4-c698-420a-9a8c-a89f7152709c req-77c85b5a-2c6b-4d68-9183-42a9dce0ec91 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a07a28f4-c698-420a-9a8c-a89f7152709c req-77c85b5a-2c6b-4d68-9183-42a9dce0ec91 service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a07a28f4-c698-420a-9a8c-a89f7152709c req-77c85b5a-2c6b-4d68-9183-42a9dce0ec91 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a07a28f4-c698-420a-9a8c-a89f7152709c req-77c85b5a-2c6b-4d68-9183-42a9dce0ec91 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-a07a28f4-c698-420a-9a8c-a89f7152709c req-77c85b5a-2c6b-4d68-9183-42a9dce0ec91 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-a07a28f4-c698-420a-9a8c-a89f7152709c req-77c85b5a-2c6b-4d68-9183-42a9dce0ec91 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-unplugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:10:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Instance destroyed successfully.
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'resources' on Instance uuid 5170f08d-a847-4094-82b7-749797acf8b7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1872031898',display_name='tempest-AttachVolumeTestJSON-server-1872031898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1872031898',id=18,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMusZ7h6tKj2bbY3n/6i+b5VoB3iIZjbFumYBt4dHNONcM6iMAxZuXjhq0TxaysZWAmLZjFvJSENUA0xW2Rf+dq+zW4aeoc380SLJFpO1DP9hR/TiQ7Ms/LwLaV0Wjjq0A==',key_name='tempest-keypair-1712050400',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-050xge3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:08:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=5170f08d-a847-4094-82b7-749797acf8b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "address": "fa:16:3e:b8:f9:8b", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7026c22f-40", "ovs_interfaceid": "7026c22f-40fe-4665-9fb8-5d116dfe7513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG os_vif [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7026c22f-40, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:10:11 user nova-compute[72803]: INFO os_vif [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:f9:8b,bridge_name='br-int',has_traffic_filtering=True,id=7026c22f-40fe-4665-9fb8-5d116dfe7513,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7026c22f-40')
Aug 15 07:10:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Deleting instance files /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7_del
Aug 15 07:10:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Deletion of /opt/stack/data/nova/instances/5170f08d-a847-4094-82b7-749797acf8b7_del complete
Aug 15 07:10:11 user nova-compute[72803]: INFO nova.compute.manager [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 07:10:11 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:10:11 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:10:12 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:10:12 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Took 1.13 seconds to deallocate network for instance.
Aug 15 07:10:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-244598d6-da77-4640-8924-3f7078e3b2c8 req-40b28bcd-2115-4036-bac3-ecb2923b739d service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-deleted-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:12 user nova-compute[72803]: INFO nova.compute.manager [req-244598d6-da77-4640-8924-3f7078e3b2c8 req-40b28bcd-2115-4036-bac3-ecb2923b739d service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Neutron deleted interface 7026c22f-40fe-4665-9fb8-5d116dfe7513; detaching it from the instance and deleting it from the info cache
Aug 15 07:10:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-244598d6-da77-4640-8924-3f7078e3b2c8 req-40b28bcd-2115-4036-bac3-ecb2923b739d service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:10:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-244598d6-da77-4640-8924-3f7078e3b2c8 req-40b28bcd-2115-4036-bac3-ecb2923b739d service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Detach interface failed, port_id=7026c22f-40fe-4665-9fb8-5d116dfe7513, reason: Instance 5170f08d-a847-4094-82b7-749797acf8b7 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:10:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:13 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:10:13 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:10:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-b06761ab-09d3-49e3-9b7f-27affcfcb245 req-cabe2575-8bfe-490c-bd37-bb5871c45411 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b06761ab-09d3-49e3-9b7f-27affcfcb245 req-cabe2575-8bfe-490c-bd37-bb5871c45411 service nova] Acquiring lock "5170f08d-a847-4094-82b7-749797acf8b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b06761ab-09d3-49e3-9b7f-27affcfcb245 req-cabe2575-8bfe-490c-bd37-bb5871c45411 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b06761ab-09d3-49e3-9b7f-27affcfcb245 req-cabe2575-8bfe-490c-bd37-bb5871c45411 service nova] Lock "5170f08d-a847-4094-82b7-749797acf8b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-b06761ab-09d3-49e3-9b7f-27affcfcb245 req-cabe2575-8bfe-490c-bd37-bb5871c45411 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] No waiting events found dispatching network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:10:13 user nova-compute[72803]: WARNING nova.compute.manager [req-b06761ab-09d3-49e3-9b7f-27affcfcb245 req-cabe2575-8bfe-490c-bd37-bb5871c45411 service nova] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Received unexpected event network-vif-plugged-7026c22f-40fe-4665-9fb8-5d116dfe7513 for instance with vm_state deleted and task_state None.
Aug 15 07:10:13 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Deleted allocations for instance 5170f08d-a847-4094-82b7-749797acf8b7
Aug 15 07:10:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d1b4ac2a-106d-4848-80bc-67c6d90184fa tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "5170f08d-a847-4094-82b7-749797acf8b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:16 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:26 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083411.4454188, 5170f08d-a847-4094-82b7-749797acf8b7 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:10:26 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] VM Stopped (Lifecycle Event)
Aug 15 07:10:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-4cc096ca-c932-4c08-bee9-b2eae6c52584 None None] [instance: 5170f08d-a847-4094-82b7-749797acf8b7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:10:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:10:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:10:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:10:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:10:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:33 user nova-compute[72803]: INFO nova.compute.manager [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Detaching volume 535a4c9b-f62b-4250-8d4c-ce89a0368014
Aug 15 07:10:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:33 user nova-compute[72803]: INFO nova.virt.block_device [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Attempting to driver detach volume 535a4c9b-f62b-4250-8d4c-ce89a0368014 from mountpoint /dev/vdb
Aug 15 07:10:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Attempting to detach device vdb from instance 6e24f20a-5872-4b4b-bbad-0528fe4ec73b from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:10:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:10:33 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:10:33 user nova-compute[72803]:   <source dev="/dev/sde"/>
Aug 15 07:10:33 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:10:33 user nova-compute[72803]:   <serial>535a4c9b-f62b-4250-8d4c-ce89a0368014</serial>
Aug 15 07:10:33 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:10:33 user nova-compute[72803]: </disk>
Aug 15 07:10:33 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:10:33 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Successfully detached device vdb from instance 6e24f20a-5872-4b4b-bbad-0528fe4ec73b from the persistent domain config.
Aug 15 07:10:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e24f20a-5872-4b4b-bbad-0528fe4ec73b from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:10:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:10:33 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:10:33 user nova-compute[72803]:   <source dev="/dev/sde"/>
Aug 15 07:10:33 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:10:33 user nova-compute[72803]:   <serial>535a4c9b-f62b-4250-8d4c-ce89a0368014</serial>
Aug 15 07:10:33 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:10:33 user nova-compute[72803]: </disk>
Aug 15 07:10:33 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083434.155259, 6e24f20a-5872-4b4b-bbad-0528fe4ec73b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e24f20a-5872-4b4b-bbad-0528fe4ec73b {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:10:34 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Successfully detached device vdb from instance 6e24f20a-5872-4b4b-bbad-0528fe4ec73b from the live domain config.
Aug 15 07:10:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzWOZvrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:10:34 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c399e9d-9ac3-4b1f-a6f0-09eb0a4afbe7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[de152e83-b19e-43f7-8c4a-a53aa75ab27f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:10:34 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:10:34 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:10:34 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:10:34 user nova-compute[72803]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 (non-flash)
Aug 15 07:10:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:10:34 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:10:34 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:10:34 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:10:34 user nova-compute[72803]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 (non-flash)
Aug 15 07:10:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0528f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014'): ({'sde'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Removing single pathed devices sde {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4e6ca-b26d-4abe-86aa-731e2a8e746c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c346fc8d-80aa-4c57-a3c2-81f294e45846]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Flushing IO for device /dev/sde {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[211e7ab3-c004-4ea4-b3ce-70b57f25acc5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08dbe0a-1b9c-433a-801f-0ccf24f74230]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] SCSI volumes sde have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e765fff-565d-487f-bb68-afd3e3d8939c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf51f6b-3462-46e2-a5b9-55c5f1967881]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014, portal: 172.16.0.220,3260]
Aug 15 07:10:34 user nova-compute[72803]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014, portal: 172.16.0.220,3260] successful.
Aug 15 07:10:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf1dbee-9c8a-45b0-b18b-9993be0684bf]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] <== disconnect_volume: return (294ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:10:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG nova.objects.instance [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'flavor' on Instance uuid 6e24f20a-5872-4b4b-bbad-0528fe4ec73b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0ad90ea3-126c-40fd-ab91-36695ae33bea tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.944s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.815s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:35 user nova-compute[72803]: INFO nova.compute.manager [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Terminating instance
Aug 15 07:10:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-462b2a46-58ac-4a44-a249-018a69c6e455 req-e1853871-f60a-47c8-8664-cb3ed4978497 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received event network-vif-unplugged-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-462b2a46-58ac-4a44-a249-018a69c6e455 req-e1853871-f60a-47c8-8664-cb3ed4978497 service nova] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-462b2a46-58ac-4a44-a249-018a69c6e455 req-e1853871-f60a-47c8-8664-cb3ed4978497 service nova] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-462b2a46-58ac-4a44-a249-018a69c6e455 req-e1853871-f60a-47c8-8664-cb3ed4978497 service nova] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-462b2a46-58ac-4a44-a249-018a69c6e455 req-e1853871-f60a-47c8-8664-cb3ed4978497 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] No waiting events found dispatching network-vif-unplugged-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-462b2a46-58ac-4a44-a249-018a69c6e455 req-e1853871-f60a-47c8-8664-cb3ed4978497 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received event network-vif-unplugged-b853d6f0-5d40-4009-8395-1fe7551bd84f for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:10:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:36 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Instance destroyed successfully.
Aug 15 07:10:36 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lazy-loading 'resources' on Instance uuid 6e24f20a-5872-4b4b-bbad-0528fe4ec73b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-408434374',display_name='tempest-VolumesSnapshotTestJSON-instance-408434374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-408434374',id=31,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjE2kfHSvo8LIX48QWA260a/+z5iBb55LF1UXK9VcXqthjlS+K1Pv//+dE5Wbq/n11MMOA/EX1OnWxs62o93oFA20SaVE2dkmKmy+LzjNc9SyO+eo3VH+aNLHqPYnSKJg==',key_name='tempest-keypair-306153436',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:08:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415992ab9c124f2db890795802e64ed3',ramdisk_id='',reservation_id='r-igla949k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1700542254',owner_user_name='tempest-VolumesSnapshotTestJSON-1700542254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c445be5492b44a4ac0ab0ffb9bf6b61',uuid=6e24f20a-5872-4b4b-bbad-0528fe4ec73b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converting VIF {"id": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "address": "fa:16:3e:d2:79:10", "network": {"id": "e0ed287e-dfdb-4d61-b065-28d6a338db35", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1995436497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415992ab9c124f2db890795802e64ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb853d6f0-5d", "ovs_interfaceid": "b853d6f0-5d40-4009-8395-1fe7551bd84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:79:10,bridge_name='br-int',has_traffic_filtering=True,id=b853d6f0-5d40-4009-8395-1fe7551bd84f,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb853d6f0-5d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_vif [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:79:10,bridge_name='br-int',has_traffic_filtering=True,id=b853d6f0-5d40-4009-8395-1fe7551bd84f,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb853d6f0-5d') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb853d6f0-5d, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:36 user nova-compute[72803]: INFO os_vif [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:79:10,bridge_name='br-int',has_traffic_filtering=True,id=b853d6f0-5d40-4009-8395-1fe7551bd84f,network=Network(e0ed287e-dfdb-4d61-b065-28d6a338db35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb853d6f0-5d')
Aug 15 07:10:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzWOZvrR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:10:36 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535a4c9b-f62b-4250-8d4c-ce89a0368014', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69293dd-31df-41e2-bdef-a40295d95251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7abb01e-7b0e-4c7e-babe-36c09b09c93a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:10:36 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:10:36 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:10:36 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:10:36 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:10:36 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:10:36 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:10:36 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:10:36 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f350f463880>, {}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Disconnecting from: [] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] <== disconnect_volume: return (56ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:10:36 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Deleting instance files /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b_del
Aug 15 07:10:36 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Deletion of /opt/stack/data/nova/instances/6e24f20a-5872-4b4b-bbad-0528fe4ec73b_del complete
Aug 15 07:10:36 user nova-compute[72803]: INFO nova.compute.manager [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 15 07:10:36 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:10:36 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:10:37 user nova-compute[72803]: INFO nova.compute.manager [None req-758b1879-ba99-4a08-b16d-470b57c5985d tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Unrescuing
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-758b1879-ba99-4a08-b16d-470b57c5985d tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-758b1879-ba99-4a08-b16d-470b57c5985d tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquired lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-758b1879-ba99-4a08-b16d-470b57c5985d tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:10:37 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Took 1.04 seconds to deallocate network for instance.
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-d9767789-7d04-40a0-9af1-2ac3b35999a3 req-7500ea4d-af8c-4a12-b7f6-2583eb4fe117 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received event network-vif-deleted-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:37 user nova-compute[72803]: WARNING nova.volume.cinder [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Attachment e253f4ba-8032-432d-815f-77d013fdba8e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e253f4ba-8032-432d-815f-77d013fdba8e. (HTTP 404) (Request-ID: req-68c79ee9-d366-47b2-8ccb-ee07b66f8f6e)
Aug 15 07:10:37 user nova-compute[72803]: INFO nova.compute.manager [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-25d86ea5-495e-4dea-99a4-3cfbd1fa81c6 req-7116c3e6-0366-4dc8-b304-c428f7375589 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received event network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-25d86ea5-495e-4dea-99a4-3cfbd1fa81c6 req-7116c3e6-0366-4dc8-b304-c428f7375589 service nova] Acquiring lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-25d86ea5-495e-4dea-99a4-3cfbd1fa81c6 req-7116c3e6-0366-4dc8-b304-c428f7375589 service nova] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-25d86ea5-495e-4dea-99a4-3cfbd1fa81c6 req-7116c3e6-0366-4dc8-b304-c428f7375589 service nova] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-25d86ea5-495e-4dea-99a4-3cfbd1fa81c6 req-7116c3e6-0366-4dc8-b304-c428f7375589 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] No waiting events found dispatching network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:10:37 user nova-compute[72803]: WARNING nova.compute.manager [req-25d86ea5-495e-4dea-99a4-3cfbd1fa81c6 req-7116c3e6-0366-4dc8-b304-c428f7375589 service nova] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Received unexpected event network-vif-plugged-b853d6f0-5d40-4009-8395-1fe7551bd84f for instance with vm_state deleted and task_state None.
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:37 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Deleted allocations for instance 6e24f20a-5872-4b4b-bbad-0528fe4ec73b
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-758b1879-ba99-4a08-b16d-470b57c5985d tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Updating instance_info_cache with network_info: [{"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-758b1879-ba99-4a08-b16d-470b57c5985d tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Releasing lock "refresh_cache-549d5d40-8521-4a9b-abbd-f6319b5b393b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG nova.objects.instance [None req-758b1879-ba99-4a08-b16d-470b57c5985d tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'flavor' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:10:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5cbd382-2971-4952-a5e0-ac32dee8af15 tempest-VolumesSnapshotTestJSON-1700542254 tempest-VolumesSnapshotTestJSON-1700542254-project-member] Lock "6e24f20a-5872-4b4b-bbad-0528fe4ec73b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.699s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG nova.compute.manager [req-c8ab3240-9217-451e-8747-560220b11946 req-72136250-60d7-4b20-a5e1-f69477639cf7 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8ab3240-9217-451e-8747-560220b11946 req-72136250-60d7-4b20-a5e1-f69477639cf7 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8ab3240-9217-451e-8747-560220b11946 req-72136250-60d7-4b20-a5e1-f69477639cf7 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8ab3240-9217-451e-8747-560220b11946 req-72136250-60d7-4b20-a5e1-f69477639cf7 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG nova.compute.manager [req-c8ab3240-9217-451e-8747-560220b11946 req-72136250-60d7-4b20-a5e1-f69477639cf7 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:10:38 user nova-compute[72803]: WARNING nova.compute.manager [req-c8ab3240-9217-451e-8747-560220b11946 req-72136250-60d7-4b20-a5e1-f69477639cf7 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:10:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance destroyed successfully.
Aug 15 07:10:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-3463ea09-25f4-44a3-b7c3-ecf80dc53c09 req-b456f2ee-86f1-4e66-bd76-142d0c57c236 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3463ea09-25f4-44a3-b7c3-ecf80dc53c09 req-b456f2ee-86f1-4e66-bd76-142d0c57c236 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3463ea09-25f4-44a3-b7c3-ecf80dc53c09 req-b456f2ee-86f1-4e66-bd76-142d0c57c236 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3463ea09-25f4-44a3-b7c3-ecf80dc53c09 req-b456f2ee-86f1-4e66-bd76-142d0c57c236 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-3463ea09-25f4-44a3-b7c3-ecf80dc53c09 req-b456f2ee-86f1-4e66-bd76-142d0c57c236 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:10:40 user nova-compute[72803]: WARNING nova.compute.manager [req-3463ea09-25f4-44a3-b7c3-ecf80dc53c09 req-b456f2ee-86f1-4e66-bd76-142d0c57c236 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:10:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:41 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:41 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:10:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:10:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:10:41 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [{"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-ae246e06-40b2-4c05-a7b7-63f016a8ea03" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 549d5d40-8521-4a9b-abbd-f6319b5b393b due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083442.3809123, 549d5d40-8521-4a9b-abbd-f6319b5b393b => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:10:42 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] VM Resumed (Lifecycle Event)
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-758b1879-ba99-4a08-b16d-470b57c5985d tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:10:42 user nova-compute[72803]: WARNING nova.compute.manager [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:10:42 user nova-compute[72803]: WARNING nova.compute.manager [req-becf8af6-a64b-448d-9722-28a3c8f9c48f req-5b57886e-8f1f-4039-89d0-00d0cbe36fe6 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:10:42 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083442.3818288, 549d5d40-8521-4a9b-abbd-f6319b5b393b => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:10:42 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] VM Started (Lifecycle Event)
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:10:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:10:44 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:10:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:45 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:10:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:10:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:10:48 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:10:48 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=25.304248809814453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Applying migration context for instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 as it has an incoming, in-progress migration 09bf0bf3-931c-4147-b9af-d2ca4d167826. Migration status is finished {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 07:10:48 user nova-compute[72803]: INFO nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating resource usage from migration 09bf0bf3-931c-4147-b9af-d2ca4d167826
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 549d5d40-8521-4a9b-abbd-f6319b5b393b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ae246e06-40b2-4c05-a7b7-63f016a8ea03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Migration 09bf0bf3-931c-4147-b9af-d2ca4d167826 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:10:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:10:51 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083436.0987608, 6e24f20a-5872-4b4b-bbad-0528fe4ec73b => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:10:51 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] VM Stopped (Lifecycle Event)
Aug 15 07:10:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-197330e1-dffa-4077-be1c-76ac3d4fc96d None None] [instance: 6e24f20a-5872-4b4b-bbad-0528fe4ec73b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:10:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:10:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Going to confirm migration 2 {{(pid=72803) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquired lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG nova.objects.instance [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'info_cache' on Instance uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating instance_info_cache with network_info: [{"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Releasing lock "refresh_cache-36431f5c-df19-4836-ae18-8e9f7ae8d066" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG nova.objects.instance [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'migration_context' on Instance uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:04 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:11:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:11:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.370s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:04 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Deleted allocation for migration 09bf0bf3-931c-4147-b9af-d2ca4d167826
Aug 15 07:11:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df0ec229-fbe5-488c-8c39-3ecccf56413d tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.640s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:11:06 user nova-compute[72803]: INFO nova.compute.claims [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Claim successful on node user
Aug 15 07:11:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:11:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.policy [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeef867bec97404e9bd1f9810b93ba29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa20f14f0f14b6791cce17d3fec420d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:11:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Creating image(s)
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "/opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "/opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.203s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk 1073741824" returned: 0 in 0.051s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.233s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Cannot resize image /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'migration_context' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Ensure instance console log exists: /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Successfully created port: 3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:11:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Successfully updated port: 3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:11:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:11:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquired lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:11:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:11:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-1e962894-318b-4cdb-8817-06b99347c43c req-dc45826c-847b-44f0-a912-b8ce7c77378b service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-changed-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-1e962894-318b-4cdb-8817-06b99347c43c req-dc45826c-847b-44f0-a912-b8ce7c77378b service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Refreshing instance network info cache due to event network-changed-3a972661-dcbf-44be-91a3-f74578045e98. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:11:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1e962894-318b-4cdb-8817-06b99347c43c req-dc45826c-847b-44f0-a912-b8ce7c77378b service nova] Acquiring lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Updating instance_info_cache with network_info: [{"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Releasing lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Instance network_info: |[{"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1e962894-318b-4cdb-8817-06b99347c43c req-dc45826c-847b-44f0-a912-b8ce7c77378b service nova] Acquired lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-1e962894-318b-4cdb-8817-06b99347c43c req-dc45826c-847b-44f0-a912-b8ce7c77378b service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Refreshing network info cache for port 3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Start _get_guest_xml network_info=[{"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:11:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:11:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:11:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-588430485',display_name='tempest-AttachVolumeTestJSON-server-588430485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-588430485',id=32,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwRyZiKqD14x++a957wdcfmwomoKfT5Hqa1Fx+LjlhmsFgAghFnobZ5qlWhIh3iuZ4HjIFQqCdHb3Aj1WHZw1TqjFgDC12NG8XIOdTa7aIepvjAFZOAZ7SAjuK0jjCvag==',key_name='tempest-keypair-1726035006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-d35jg01a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9a:83,bridge_name='br-int',has_traffic_filtering=True,id=3a972661-dcbf-44be-91a3-f74578045e98,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a972661-dc') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:11:09 user nova-compute[72803]:   <uuid>7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7</uuid>
Aug 15 07:11:09 user nova-compute[72803]:   <name>instance-00000020</name>
Aug 15 07:11:09 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:11:09 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:11:09 user nova-compute[72803]:   <metadata>
Aug 15 07:11:09 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:11:09 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:11:09 user nova-compute[72803]:       <nova:name>tempest-AttachVolumeTestJSON-server-588430485</nova:name>
Aug 15 07:11:09 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:11:09</nova:creationTime>
Aug 15 07:11:09 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:11:09 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:11:09 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:11:09 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:11:09 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:11:09 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:11:09 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:11:09 user nova-compute[72803]:       <nova:owner>
Aug 15 07:11:09 user nova-compute[72803]:         <nova:user uuid="aeef867bec97404e9bd1f9810b93ba29">tempest-AttachVolumeTestJSON-820469847-project-member</nova:user>
Aug 15 07:11:09 user nova-compute[72803]:         <nova:project uuid="faa20f14f0f14b6791cce17d3fec420d">tempest-AttachVolumeTestJSON-820469847</nova:project>
Aug 15 07:11:09 user nova-compute[72803]:       </nova:owner>
Aug 15 07:11:09 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:11:09 user nova-compute[72803]:       <nova:ports>
Aug 15 07:11:09 user nova-compute[72803]:         <nova:port uuid="3a972661-dcbf-44be-91a3-f74578045e98">
Aug 15 07:11:09 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 07:11:09 user nova-compute[72803]:         </nova:port>
Aug 15 07:11:09 user nova-compute[72803]:       </nova:ports>
Aug 15 07:11:09 user nova-compute[72803]:     </nova:instance>
Aug 15 07:11:09 user nova-compute[72803]:   </metadata>
Aug 15 07:11:09 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:11:09 user nova-compute[72803]:     <system>
Aug 15 07:11:09 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:11:09 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:11:09 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:11:09 user nova-compute[72803]:       <entry name="serial">7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7</entry>
Aug 15 07:11:09 user nova-compute[72803]:       <entry name="uuid">7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7</entry>
Aug 15 07:11:09 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:11:09 user nova-compute[72803]:     </system>
Aug 15 07:11:09 user nova-compute[72803]:   </sysinfo>
Aug 15 07:11:09 user nova-compute[72803]:   <os>
Aug 15 07:11:09 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:11:09 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:11:09 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:11:09 user nova-compute[72803]:   </os>
Aug 15 07:11:09 user nova-compute[72803]:   <features>
Aug 15 07:11:09 user nova-compute[72803]:     <acpi/>
Aug 15 07:11:09 user nova-compute[72803]:     <apic/>
Aug 15 07:11:09 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:11:09 user nova-compute[72803]:   </features>
Aug 15 07:11:09 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:11:09 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:11:09 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:11:09 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:11:09 user nova-compute[72803]:   </clock>
Aug 15 07:11:09 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:11:09 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:11:09 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:11:09 user nova-compute[72803]:   </cpu>
Aug 15 07:11:09 user nova-compute[72803]:   <devices>
Aug 15 07:11:09 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:11:09 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:11:09 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk"/>
Aug 15 07:11:09 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:11:09 user nova-compute[72803]:     </disk>
Aug 15 07:11:09 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:11:09 user nova-compute[72803]:       <mac address="fa:16:3e:b2:9a:83"/>
Aug 15 07:11:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:11:09 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:11:09 user nova-compute[72803]:       <target dev="tap3a972661-dc"/>
Aug 15 07:11:09 user nova-compute[72803]:     </interface>
Aug 15 07:11:09 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:11:09 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/console.log" append="off"/>
Aug 15 07:11:09 user nova-compute[72803]:     </serial>
Aug 15 07:11:09 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:11:09 user nova-compute[72803]:     <video>
Aug 15 07:11:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:11:09 user nova-compute[72803]:     </video>
Aug 15 07:11:09 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:11:09 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:11:09 user nova-compute[72803]:     </rng>
Aug 15 07:11:09 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:11:09 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:11:09 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:11:09 user nova-compute[72803]:     </memballoon>
Aug 15 07:11:09 user nova-compute[72803]:   </devices>
Aug 15 07:11:09 user nova-compute[72803]: </domain>
Aug 15 07:11:09 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:11:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-588430485',display_name='tempest-AttachVolumeTestJSON-server-588430485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-588430485',id=32,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwRyZiKqD14x++a957wdcfmwomoKfT5Hqa1Fx+LjlhmsFgAghFnobZ5qlWhIh3iuZ4HjIFQqCdHb3Aj1WHZw1TqjFgDC12NG8XIOdTa7aIepvjAFZOAZ7SAjuK0jjCvag==',key_name='tempest-keypair-1726035006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-d35jg01a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9a:83,bridge_name='br-int',has_traffic_filtering=True,id=3a972661-dcbf-44be-91a3-f74578045e98,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a972661-dc') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG os_vif [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9a:83,bridge_name='br-int',has_traffic_filtering=True,id=3a972661-dcbf-44be-91a3-f74578045e98,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a972661-dc') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a972661-dc, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a972661-dc, col_values=(('external_ids', {'iface-id': '3a972661-dcbf-44be-91a3-f74578045e98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:9a:83', 'vm-uuid': '7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:09 user nova-compute[72803]: INFO os_vif [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9a:83,bridge_name='br-int',has_traffic_filtering=True,id=3a972661-dcbf-44be-91a3-f74578045e98,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a972661-dc')
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No VIF found with MAC fa:16:3e:b2:9a:83, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-1e962894-318b-4cdb-8817-06b99347c43c req-dc45826c-847b-44f0-a912-b8ce7c77378b service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Updated VIF entry in instance network info cache for port 3a972661-dcbf-44be-91a3-f74578045e98. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-1e962894-318b-4cdb-8817-06b99347c43c req-dc45826c-847b-44f0-a912-b8ce7c77378b service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Updating instance_info_cache with network_info: [{"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:11:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1e962894-318b-4cdb-8817-06b99347c43c req-dc45826c-847b-44f0-a912-b8ce7c77378b service nova] Releasing lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-bda35862-ca30-43a4-85a5-40cbc8d791c1 req-75e12f0c-d4a8-40d1-83dd-6c3860677b97 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bda35862-ca30-43a4-85a5-40cbc8d791c1 req-75e12f0c-d4a8-40d1-83dd-6c3860677b97 service nova] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bda35862-ca30-43a4-85a5-40cbc8d791c1 req-75e12f0c-d4a8-40d1-83dd-6c3860677b97 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bda35862-ca30-43a4-85a5-40cbc8d791c1 req-75e12f0c-d4a8-40d1-83dd-6c3860677b97 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-bda35862-ca30-43a4-85a5-40cbc8d791c1 req-75e12f0c-d4a8-40d1-83dd-6c3860677b97 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] No waiting events found dispatching network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:11:11 user nova-compute[72803]: WARNING nova.compute.manager [req-bda35862-ca30-43a4-85a5-40cbc8d791c1 req-75e12f0c-d4a8-40d1-83dd-6c3860677b97 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received unexpected event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 for instance with vm_state building and task_state spawning.
Aug 15 07:11:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083473.470703, 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:11:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] VM Resumed (Lifecycle Event)
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:11:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Instance spawned successfully.
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-b3b5db04-a317-4731-8d5e-9e1319cbbfcd req-ea2eccdb-9875-41c4-92c3-7dfd8a6f52a7 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b3b5db04-a317-4731-8d5e-9e1319cbbfcd req-ea2eccdb-9875-41c4-92c3-7dfd8a6f52a7 service nova] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b3b5db04-a317-4731-8d5e-9e1319cbbfcd req-ea2eccdb-9875-41c4-92c3-7dfd8a6f52a7 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b3b5db04-a317-4731-8d5e-9e1319cbbfcd req-ea2eccdb-9875-41c4-92c3-7dfd8a6f52a7 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-b3b5db04-a317-4731-8d5e-9e1319cbbfcd req-ea2eccdb-9875-41c4-92c3-7dfd8a6f52a7 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] No waiting events found dispatching network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:11:13 user nova-compute[72803]: WARNING nova.compute.manager [req-b3b5db04-a317-4731-8d5e-9e1319cbbfcd req-ea2eccdb-9875-41c4-92c3-7dfd8a6f52a7 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received unexpected event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 for instance with vm_state building and task_state spawning.
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083473.4750035, 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:11:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] VM Started (Lifecycle Event)
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:11:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:11:13 user nova-compute[72803]: INFO nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Took 6.83 seconds to spawn the instance on the hypervisor.
Aug 15 07:11:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:11:13 user nova-compute[72803]: INFO nova.compute.manager [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Took 7.64 seconds to build instance.
Aug 15 07:11:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1968d48a-7994-40e7-8d8d-865a229d8e24 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.745s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:35 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:11:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:11:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "f43c9933-39ab-4d03-a399-d4014456de91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f43c9933-39ab-4d03-a399-d4014456de91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:36 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:11:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:36 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:11:36 user nova-compute[72803]: INFO nova.compute.claims [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Claim successful on node user
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:11:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.policy [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b510bc4a21940ae904886cfeaa8e29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c703e687f99045339795915d5dff031e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:11:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Creating image(s)
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "/opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "/opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "/opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk 1073741824" returned: 0 in 0.049s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.216s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Successfully created port: c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Cannot resize image /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lazy-loading 'migration_context' on Instance uuid f43c9933-39ab-4d03-a399-d4014456de91 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Ensure instance console log exists: /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Successfully updated port: c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "refresh_cache-f43c9933-39ab-4d03-a399-d4014456de91" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquired lock "refresh_cache-f43c9933-39ab-4d03-a399-d4014456de91" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-07b2c861-bafd-44fb-8464-ac445de6b5ed req-f6022226-2d0b-4482-b283-e50d1931ecf8 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received event network-changed-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-07b2c861-bafd-44fb-8464-ac445de6b5ed req-f6022226-2d0b-4482-b283-e50d1931ecf8 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Refreshing instance network info cache due to event network-changed-c5794532-679e-4b77-95c0-ac4315d6d9be. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-07b2c861-bafd-44fb-8464-ac445de6b5ed req-f6022226-2d0b-4482-b283-e50d1931ecf8 service nova] Acquiring lock "refresh_cache-f43c9933-39ab-4d03-a399-d4014456de91" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.neutron [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Updating instance_info_cache with network_info: [{"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Releasing lock "refresh_cache-f43c9933-39ab-4d03-a399-d4014456de91" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Instance network_info: |[{"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-07b2c861-bafd-44fb-8464-ac445de6b5ed req-f6022226-2d0b-4482-b283-e50d1931ecf8 service nova] Acquired lock "refresh_cache-f43c9933-39ab-4d03-a399-d4014456de91" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.neutron [req-07b2c861-bafd-44fb-8464-ac445de6b5ed req-f6022226-2d0b-4482-b283-e50d1931ecf8 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Refreshing network info cache for port c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Start _get_guest_xml network_info=[{"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:11:39 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:11:39 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-690669247',display_name='tempest-VolumesActionsTest-instance-690669247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-690669247',id=33,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c703e687f99045339795915d5dff031e',ramdisk_id='',reservation_id='r-p3rcxeem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1941402153',owner_user_name='tempest-VolumesActionsTest-1941402153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:11:38Z,user_data=None,user_id='9b510bc4a21940ae904886cfeaa8e29f',uuid=f43c9933-39ab-4d03-a399-d4014456de91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converting VIF {"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5794532-679e-4b77-95c0-ac4315d6d9be,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5794532-67') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.objects.instance [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lazy-loading 'pci_devices' on Instance uuid f43c9933-39ab-4d03-a399-d4014456de91 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:11:39 user nova-compute[72803]:   <uuid>f43c9933-39ab-4d03-a399-d4014456de91</uuid>
Aug 15 07:11:39 user nova-compute[72803]:   <name>instance-00000021</name>
Aug 15 07:11:39 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:11:39 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:11:39 user nova-compute[72803]:   <metadata>
Aug 15 07:11:39 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:11:39 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:11:39 user nova-compute[72803]:       <nova:name>tempest-VolumesActionsTest-instance-690669247</nova:name>
Aug 15 07:11:39 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:11:39</nova:creationTime>
Aug 15 07:11:39 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:11:39 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:11:39 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:11:39 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:11:39 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:11:39 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:11:39 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:11:39 user nova-compute[72803]:       <nova:owner>
Aug 15 07:11:39 user nova-compute[72803]:         <nova:user uuid="9b510bc4a21940ae904886cfeaa8e29f">tempest-VolumesActionsTest-1941402153-project-member</nova:user>
Aug 15 07:11:39 user nova-compute[72803]:         <nova:project uuid="c703e687f99045339795915d5dff031e">tempest-VolumesActionsTest-1941402153</nova:project>
Aug 15 07:11:39 user nova-compute[72803]:       </nova:owner>
Aug 15 07:11:39 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:11:39 user nova-compute[72803]:       <nova:ports>
Aug 15 07:11:39 user nova-compute[72803]:         <nova:port uuid="c5794532-679e-4b77-95c0-ac4315d6d9be">
Aug 15 07:11:39 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 07:11:39 user nova-compute[72803]:         </nova:port>
Aug 15 07:11:39 user nova-compute[72803]:       </nova:ports>
Aug 15 07:11:39 user nova-compute[72803]:     </nova:instance>
Aug 15 07:11:39 user nova-compute[72803]:   </metadata>
Aug 15 07:11:39 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:11:39 user nova-compute[72803]:     <system>
Aug 15 07:11:39 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:11:39 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:11:39 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:11:39 user nova-compute[72803]:       <entry name="serial">f43c9933-39ab-4d03-a399-d4014456de91</entry>
Aug 15 07:11:39 user nova-compute[72803]:       <entry name="uuid">f43c9933-39ab-4d03-a399-d4014456de91</entry>
Aug 15 07:11:39 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:11:39 user nova-compute[72803]:     </system>
Aug 15 07:11:39 user nova-compute[72803]:   </sysinfo>
Aug 15 07:11:39 user nova-compute[72803]:   <os>
Aug 15 07:11:39 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:11:39 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:11:39 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:11:39 user nova-compute[72803]:   </os>
Aug 15 07:11:39 user nova-compute[72803]:   <features>
Aug 15 07:11:39 user nova-compute[72803]:     <acpi/>
Aug 15 07:11:39 user nova-compute[72803]:     <apic/>
Aug 15 07:11:39 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:11:39 user nova-compute[72803]:   </features>
Aug 15 07:11:39 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:11:39 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:11:39 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:11:39 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:11:39 user nova-compute[72803]:   </clock>
Aug 15 07:11:39 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:11:39 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:11:39 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:11:39 user nova-compute[72803]:   </cpu>
Aug 15 07:11:39 user nova-compute[72803]:   <devices>
Aug 15 07:11:39 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:11:39 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:11:39 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk"/>
Aug 15 07:11:39 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:11:39 user nova-compute[72803]:     </disk>
Aug 15 07:11:39 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:11:39 user nova-compute[72803]:       <mac address="fa:16:3e:6f:cf:3f"/>
Aug 15 07:11:39 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:11:39 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:11:39 user nova-compute[72803]:       <target dev="tapc5794532-67"/>
Aug 15 07:11:39 user nova-compute[72803]:     </interface>
Aug 15 07:11:39 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:11:39 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/console.log" append="off"/>
Aug 15 07:11:39 user nova-compute[72803]:     </serial>
Aug 15 07:11:39 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:11:39 user nova-compute[72803]:     <video>
Aug 15 07:11:39 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:11:39 user nova-compute[72803]:     </video>
Aug 15 07:11:39 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:11:39 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:11:39 user nova-compute[72803]:     </rng>
Aug 15 07:11:39 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:11:39 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:11:39 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:11:39 user nova-compute[72803]:     </memballoon>
Aug 15 07:11:39 user nova-compute[72803]:   </devices>
Aug 15 07:11:39 user nova-compute[72803]: </domain>
Aug 15 07:11:39 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-690669247',display_name='tempest-VolumesActionsTest-instance-690669247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-690669247',id=33,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c703e687f99045339795915d5dff031e',ramdisk_id='',reservation_id='r-p3rcxeem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1941402153',owner_user_name='tempest-VolumesActionsTest-1941402153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:11:38Z,user_data=None,user_id='9b510bc4a21940ae904886cfeaa8e29f',uuid=f43c9933-39ab-4d03-a399-d4014456de91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converting VIF {"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5794532-679e-4b77-95c0-ac4315d6d9be,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5794532-67') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG os_vif [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5794532-679e-4b77-95c0-ac4315d6d9be,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5794532-67') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5794532-67, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5794532-67, col_values=(('external_ids', {'iface-id': 'c5794532-679e-4b77-95c0-ac4315d6d9be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:cf:3f', 'vm-uuid': 'f43c9933-39ab-4d03-a399-d4014456de91'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:39 user nova-compute[72803]: INFO os_vif [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5794532-679e-4b77-95c0-ac4315d6d9be,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5794532-67')
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:11:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] No VIF found with MAC fa:16:3e:6f:cf:3f, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:11:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-07b2c861-bafd-44fb-8464-ac445de6b5ed req-f6022226-2d0b-4482-b283-e50d1931ecf8 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Updated VIF entry in instance network info cache for port c5794532-679e-4b77-95c0-ac4315d6d9be. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:11:40 user nova-compute[72803]: DEBUG nova.network.neutron [req-07b2c861-bafd-44fb-8464-ac445de6b5ed req-f6022226-2d0b-4482-b283-e50d1931ecf8 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Updating instance_info_cache with network_info: [{"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:11:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-07b2c861-bafd-44fb-8464-ac445de6b5ed req-f6022226-2d0b-4482-b283-e50d1931ecf8 service nova] Releasing lock "refresh_cache-f43c9933-39ab-4d03-a399-d4014456de91" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:11:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:40 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG nova.compute.manager [req-157fe3f3-c104-4d9a-adb8-22bced4d3e67 req-8772019d-9c2f-471b-b2da-f4d7efe7872c service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received event network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-157fe3f3-c104-4d9a-adb8-22bced4d3e67 req-8772019d-9c2f-471b-b2da-f4d7efe7872c service nova] Acquiring lock "f43c9933-39ab-4d03-a399-d4014456de91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-157fe3f3-c104-4d9a-adb8-22bced4d3e67 req-8772019d-9c2f-471b-b2da-f4d7efe7872c service nova] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-157fe3f3-c104-4d9a-adb8-22bced4d3e67 req-8772019d-9c2f-471b-b2da-f4d7efe7872c service nova] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG nova.compute.manager [req-157fe3f3-c104-4d9a-adb8-22bced4d3e67 req-8772019d-9c2f-471b-b2da-f4d7efe7872c service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] No waiting events found dispatching network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:11:41 user nova-compute[72803]: WARNING nova.compute.manager [req-157fe3f3-c104-4d9a-adb8-22bced4d3e67 req-8772019d-9c2f-471b-b2da-f4d7efe7872c service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received unexpected event network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be for instance with vm_state building and task_state spawning.
Aug 15 07:11:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:42 user nova-compute[72803]: INFO nova.compute.manager [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Terminating instance
Aug 15 07:11:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-26197478-e574-4451-9983-6c00414830aa req-f3fd6b72-3cda-4b8d-8064-5a306a11a917 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-26197478-e574-4451-9983-6c00414830aa req-f3fd6b72-3cda-4b8d-8064-5a306a11a917 service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-26197478-e574-4451-9983-6c00414830aa req-f3fd6b72-3cda-4b8d-8064-5a306a11a917 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-26197478-e574-4451-9983-6c00414830aa req-f3fd6b72-3cda-4b8d-8064-5a306a11a917 service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-26197478-e574-4451-9983-6c00414830aa req-f3fd6b72-3cda-4b8d-8064-5a306a11a917 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:11:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-26197478-e574-4451-9983-6c00414830aa req-f3fd6b72-3cda-4b8d-8064-5a306a11a917 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-unplugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Instance destroyed successfully.
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.objects.instance [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lazy-loading 'resources' on Instance uuid ae246e06-40b2-4c05-a7b7-63f016a8ea03 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1170662677',display_name='tempest-ServerActionsTestOtherB-server-1170662677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1170662677',id=21,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXb+zye/MBlOtiQKevsJbXb27D/R3Nlt5ca7xOM2Oio8vw5WhpP51K9vEABq35J8t70QmMhMZt2hh5friRyBR4U+bhdbzXc6DIGNNXstusew2ZY/iBNAKmR//4lpiSTkA==',key_name='tempest-keypair-835148343',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:09:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3de2e755df9744d59e93c26feeec4ebf',ramdisk_id='',reservation_id='r-n3w2whlj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1808789614',owner_user_name='tempest-ServerActionsTestOtherB-1808789614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='701c79552e3044d0babde5510a994efa',uuid=ae246e06-40b2-4c05-a7b7-63f016a8ea03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converting VIF {"id": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "address": "fa:16:3e:32:4e:18", "network": {"id": "61d8b4ea-c7ba-4a86-b483-9e34d38febda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1617322884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3de2e755df9744d59e93c26feeec4ebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d1c280-da", "ovs_interfaceid": "89d1c280-dac6-41fa-8fb1-0d1b31c21f10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_vif [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89d1c280-da, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:11:43 user nova-compute[72803]: INFO os_vif [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4e:18,bridge_name='br-int',has_traffic_filtering=True,id=89d1c280-dac6-41fa-8fb1-0d1b31c21f10,network=Network(61d8b4ea-c7ba-4a86-b483-9e34d38febda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d1c280-da')
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmoIOEMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:11:43 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb0a85b-498e-4784-bed9-91e51a484bdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8e6173-0f51-4a26-90f6-edd391572928]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:11:43 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:11:43 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:11:43 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:11:43 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:11:43 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:11:43 user nova-compute[72803]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 (non-flash)
Aug 15 07:11:43 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:11:43 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05a9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea7a7a6-e44b-47b7-ae85-2bc9e20e61e0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb75d05-03b1-4c06-83c5-6c97bdbf034b]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6621bfb2-7548-48f4-8ff8-5ed810cdf728]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c363a3-2fd9-4434-980c-d96788cb5b7e]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9360953e-573b-496d-8883-fcdce5a8c276]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[446f1a2a-99a2-4346-b655-33cad613094f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260]
Aug 15 07:11:43 user nova-compute[72803]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765, portal: 172.16.0.220,3260] successful.
Aug 15 07:11:43 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3b23c9e-adc1-4800-bf40-740385364765 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[05be16f7-deb1-4e93-a85d-7301248851a6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] <== disconnect_volume: return (336ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Deleting instance files /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03_del
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Deletion of /opt/stack/data/nova/instances/ae246e06-40b2-4c05-a7b7-63f016a8ea03_del complete
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-fb7251ec-942f-491b-a99b-7cf2d7260a69 req-bfebf920-385e-4a04-ae24-9e01001b76cc service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received event network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fb7251ec-942f-491b-a99b-7cf2d7260a69 req-bfebf920-385e-4a04-ae24-9e01001b76cc service nova] Acquiring lock "f43c9933-39ab-4d03-a399-d4014456de91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fb7251ec-942f-491b-a99b-7cf2d7260a69 req-bfebf920-385e-4a04-ae24-9e01001b76cc service nova] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fb7251ec-942f-491b-a99b-7cf2d7260a69 req-bfebf920-385e-4a04-ae24-9e01001b76cc service nova] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-fb7251ec-942f-491b-a99b-7cf2d7260a69 req-bfebf920-385e-4a04-ae24-9e01001b76cc service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] No waiting events found dispatching network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:11:43 user nova-compute[72803]: WARNING nova.compute.manager [req-fb7251ec-942f-491b-a99b-7cf2d7260a69 req-bfebf920-385e-4a04-ae24-9e01001b76cc service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received unexpected event network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be for instance with vm_state building and task_state spawning.
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083503.6852944, f43c9933-39ab-4d03-a399-d4014456de91 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] VM Resumed (Lifecycle Event)
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.compute.manager [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 15 07:11:43 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Instance spawned successfully.
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083503.6867259, f43c9933-39ab-4d03-a399-d4014456de91 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] VM Started (Lifecycle Event)
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 15 07:11:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:11:43 user nova-compute[72803]: INFO nova.compute.manager [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Took 7.21 seconds to build instance.
Aug 15 07:11:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9d131b3c-f20b-42c4-88f3-89a1b6241969 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f43c9933-39ab-4d03-a399-d4014456de91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.333s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Updating instance_info_cache with network_info: [{"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-c2c458fd-fdc5-43df-a7c2-f53463a33119" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:11:44 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Took 1.20 seconds to deallocate network for instance.
Aug 15 07:11:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-54c13b66-0885-449c-9107-6b9da1122e92 req-52e6aae1-f32c-4e96-860d-4c145f42794f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-54c13b66-0885-449c-9107-6b9da1122e92 req-52e6aae1-f32c-4e96-860d-4c145f42794f service nova] Acquiring lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-54c13b66-0885-449c-9107-6b9da1122e92 req-52e6aae1-f32c-4e96-860d-4c145f42794f service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-54c13b66-0885-449c-9107-6b9da1122e92 req-52e6aae1-f32c-4e96-860d-4c145f42794f service nova] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-54c13b66-0885-449c-9107-6b9da1122e92 req-52e6aae1-f32c-4e96-860d-4c145f42794f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] No waiting events found dispatching network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:11:44 user nova-compute[72803]: WARNING nova.compute.manager [req-54c13b66-0885-449c-9107-6b9da1122e92 req-52e6aae1-f32c-4e96-860d-4c145f42794f service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received unexpected event network-vif-plugged-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 for instance with vm_state active and task_state deleting.
Aug 15 07:11:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-7be9afcb-b04e-4d8e-959b-c336b50d7334 req-47d1b851-a007-4711-a48c-3c2ebff70d42 service nova] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Received event network-vif-deleted-89d1c280-dac6-41fa-8fb1-0d1b31c21f10 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:11:45 user nova-compute[72803]: INFO nova.compute.manager [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Took 0.92 seconds to detach 1 volumes for instance.
Aug 15 07:11:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.044s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:11:46 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Deleted allocations for instance ae246e06-40b2-4c05-a7b7-63f016a8ea03
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-737b7019-6de7-4e4b-b3fe-cef0bea5c516 tempest-ServerActionsTestOtherB-1808789614 tempest-ServerActionsTestOtherB-1808789614-project-member] Lock "ae246e06-40b2-4c05-a7b7-63f016a8ea03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.226s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:11:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:11:49 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:11:49 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7803MB free_disk=25.287487030029297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 549d5d40-8521-4a9b-abbd-f6319b5b393b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f43c9933-39ab-4d03-a399-d4014456de91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:11:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:53 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:11:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:58 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083503.2173967, ae246e06-40b2-4c05-a7b7-63f016a8ea03 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:11:58 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] VM Stopped (Lifecycle Event)
Aug 15 07:11:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d2614096-c5f9-464f-92fb-c6373181fa5c None None] [instance: ae246e06-40b2-4c05-a7b7-63f016a8ea03] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:11:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:11:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:12:04 user nova-compute[72803]: INFO nova.compute.claims [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Claim successful on node user
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:12:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.policy [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ddf3dcceb1f41adbc0f679d1a1014b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb2074606144e48a856a092c7e32781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:12:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Creating image(s)
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "/opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "/opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.215s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk 1073741824" returned: 0 in 0.054s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Successfully created port: b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Cannot resize image /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'migration_context' on Instance uuid 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Ensure instance console log exists: /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Successfully updated port: b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:12:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:12:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquired lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:12:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:12:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-6ccfd1b9-e59c-4268-b9eb-549a3ca849e1 req-d406e3eb-e490-4001-ae05-6b6c9677d78f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-changed-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:12:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-6ccfd1b9-e59c-4268-b9eb-549a3ca849e1 req-d406e3eb-e490-4001-ae05-6b6c9677d78f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Refreshing instance network info cache due to event network-changed-b7fa2fa2-1703-498b-b254-99602006af78. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:12:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6ccfd1b9-e59c-4268-b9eb-549a3ca849e1 req-d406e3eb-e490-4001-ae05-6b6c9677d78f service nova] Acquiring lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:12:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updating instance_info_cache with network_info: [{"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Releasing lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Instance network_info: |[{"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6ccfd1b9-e59c-4268-b9eb-549a3ca849e1 req-d406e3eb-e490-4001-ae05-6b6c9677d78f service nova] Acquired lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.network.neutron [req-6ccfd1b9-e59c-4268-b9eb-549a3ca849e1 req-d406e3eb-e490-4001-ae05-6b6c9677d78f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Refreshing network info cache for port b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Start _get_guest_xml network_info=[{"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:12:07 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:12:07 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-22237353',display_name='tempest-TestStampPattern-server-22237353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-22237353',id=34,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYEdS660yr6zgAKFBXVbvLxAfpYjVGFPDW51c3q4Ydsz8Eye3gBE8udzyAe91FO7kCB6FzhaCGWoXBMPYW0RCVxd9Mg8nCu2yJHA/4Si/grKlEE/CLjLGwDhuMUdNTz9w==',key_name='tempest-TestStampPattern-1230572878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb2074606144e48a856a092c7e32781',ramdisk_id='',reservation_id='r-4y60rw8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1675165439',owner_user_name='tempest-TestStampPattern-1675165439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:12:05Z,user_data=None,user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',uuid=8d0be6c9-8e93-4a50-bf2b-d287e619b303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converting VIF {"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:30:60,bridge_name='br-int',has_traffic_filtering=True,id=b7fa2fa2-1703-498b-b254-99602006af78,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fa2fa2-17') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:12:07 user nova-compute[72803]:   <uuid>8d0be6c9-8e93-4a50-bf2b-d287e619b303</uuid>
Aug 15 07:12:07 user nova-compute[72803]:   <name>instance-00000022</name>
Aug 15 07:12:07 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:12:07 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:12:07 user nova-compute[72803]:   <metadata>
Aug 15 07:12:07 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:12:07 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:12:07 user nova-compute[72803]:       <nova:name>tempest-TestStampPattern-server-22237353</nova:name>
Aug 15 07:12:07 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:12:07</nova:creationTime>
Aug 15 07:12:07 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:12:07 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:12:07 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:12:07 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:12:07 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:12:07 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:12:07 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:12:07 user nova-compute[72803]:       <nova:owner>
Aug 15 07:12:07 user nova-compute[72803]:         <nova:user uuid="1ddf3dcceb1f41adbc0f679d1a1014b1">tempest-TestStampPattern-1675165439-project-member</nova:user>
Aug 15 07:12:07 user nova-compute[72803]:         <nova:project uuid="adb2074606144e48a856a092c7e32781">tempest-TestStampPattern-1675165439</nova:project>
Aug 15 07:12:07 user nova-compute[72803]:       </nova:owner>
Aug 15 07:12:07 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:12:07 user nova-compute[72803]:       <nova:ports>
Aug 15 07:12:07 user nova-compute[72803]:         <nova:port uuid="b7fa2fa2-1703-498b-b254-99602006af78">
Aug 15 07:12:07 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 07:12:07 user nova-compute[72803]:         </nova:port>
Aug 15 07:12:07 user nova-compute[72803]:       </nova:ports>
Aug 15 07:12:07 user nova-compute[72803]:     </nova:instance>
Aug 15 07:12:07 user nova-compute[72803]:   </metadata>
Aug 15 07:12:07 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:12:07 user nova-compute[72803]:     <system>
Aug 15 07:12:07 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:12:07 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:12:07 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:12:07 user nova-compute[72803]:       <entry name="serial">8d0be6c9-8e93-4a50-bf2b-d287e619b303</entry>
Aug 15 07:12:07 user nova-compute[72803]:       <entry name="uuid">8d0be6c9-8e93-4a50-bf2b-d287e619b303</entry>
Aug 15 07:12:07 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:12:07 user nova-compute[72803]:     </system>
Aug 15 07:12:07 user nova-compute[72803]:   </sysinfo>
Aug 15 07:12:07 user nova-compute[72803]:   <os>
Aug 15 07:12:07 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:12:07 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:12:07 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:12:07 user nova-compute[72803]:   </os>
Aug 15 07:12:07 user nova-compute[72803]:   <features>
Aug 15 07:12:07 user nova-compute[72803]:     <acpi/>
Aug 15 07:12:07 user nova-compute[72803]:     <apic/>
Aug 15 07:12:07 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:12:07 user nova-compute[72803]:   </features>
Aug 15 07:12:07 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:12:07 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:12:07 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:12:07 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:12:07 user nova-compute[72803]:   </clock>
Aug 15 07:12:07 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:12:07 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:12:07 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:12:07 user nova-compute[72803]:   </cpu>
Aug 15 07:12:07 user nova-compute[72803]:   <devices>
Aug 15 07:12:07 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:12:07 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:12:07 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk"/>
Aug 15 07:12:07 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:12:07 user nova-compute[72803]:     </disk>
Aug 15 07:12:07 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:12:07 user nova-compute[72803]:       <mac address="fa:16:3e:f5:30:60"/>
Aug 15 07:12:07 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:12:07 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:12:07 user nova-compute[72803]:       <target dev="tapb7fa2fa2-17"/>
Aug 15 07:12:07 user nova-compute[72803]:     </interface>
Aug 15 07:12:07 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:12:07 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/console.log" append="off"/>
Aug 15 07:12:07 user nova-compute[72803]:     </serial>
Aug 15 07:12:07 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:12:07 user nova-compute[72803]:     <video>
Aug 15 07:12:07 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:12:07 user nova-compute[72803]:     </video>
Aug 15 07:12:07 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:12:07 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:12:07 user nova-compute[72803]:     </rng>
Aug 15 07:12:07 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:12:07 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:12:07 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:12:07 user nova-compute[72803]:     </memballoon>
Aug 15 07:12:07 user nova-compute[72803]:   </devices>
Aug 15 07:12:07 user nova-compute[72803]: </domain>
Aug 15 07:12:07 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-22237353',display_name='tempest-TestStampPattern-server-22237353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-22237353',id=34,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYEdS660yr6zgAKFBXVbvLxAfpYjVGFPDW51c3q4Ydsz8Eye3gBE8udzyAe91FO7kCB6FzhaCGWoXBMPYW0RCVxd9Mg8nCu2yJHA/4Si/grKlEE/CLjLGwDhuMUdNTz9w==',key_name='tempest-TestStampPattern-1230572878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb2074606144e48a856a092c7e32781',ramdisk_id='',reservation_id='r-4y60rw8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1675165439',owner_user_name='tempest-TestStampPattern-1675165439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:12:05Z,user_data=None,user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',uuid=8d0be6c9-8e93-4a50-bf2b-d287e619b303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converting VIF {"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:30:60,bridge_name='br-int',has_traffic_filtering=True,id=b7fa2fa2-1703-498b-b254-99602006af78,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fa2fa2-17') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG os_vif [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:30:60,bridge_name='br-int',has_traffic_filtering=True,id=b7fa2fa2-1703-498b-b254-99602006af78,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fa2fa2-17') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7fa2fa2-17, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7fa2fa2-17, col_values=(('external_ids', {'iface-id': 'b7fa2fa2-1703-498b-b254-99602006af78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:30:60', 'vm-uuid': '8d0be6c9-8e93-4a50-bf2b-d287e619b303'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:07 user nova-compute[72803]: INFO os_vif [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:30:60,bridge_name='br-int',has_traffic_filtering=True,id=b7fa2fa2-1703-498b-b254-99602006af78,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fa2fa2-17')
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No VIF found with MAC fa:16:3e:f5:30:60, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.network.neutron [req-6ccfd1b9-e59c-4268-b9eb-549a3ca849e1 req-d406e3eb-e490-4001-ae05-6b6c9677d78f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updated VIF entry in instance network info cache for port b7fa2fa2-1703-498b-b254-99602006af78. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG nova.network.neutron [req-6ccfd1b9-e59c-4268-b9eb-549a3ca849e1 req-d406e3eb-e490-4001-ae05-6b6c9677d78f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updating instance_info_cache with network_info: [{"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:12:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6ccfd1b9-e59c-4268-b9eb-549a3ca849e1 req-d406e3eb-e490-4001-ae05-6b6c9677d78f service nova] Releasing lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:12:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb7d176c-74a1-4eaf-a9bb-62b550a69a15 req-de77aaa1-411a-46d6-83e8-6e18bdc17300 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:12:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb7d176c-74a1-4eaf-a9bb-62b550a69a15 req-de77aaa1-411a-46d6-83e8-6e18bdc17300 service nova] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb7d176c-74a1-4eaf-a9bb-62b550a69a15 req-de77aaa1-411a-46d6-83e8-6e18bdc17300 service nova] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cb7d176c-74a1-4eaf-a9bb-62b550a69a15 req-de77aaa1-411a-46d6-83e8-6e18bdc17300 service nova] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-cb7d176c-74a1-4eaf-a9bb-62b550a69a15 req-de77aaa1-411a-46d6-83e8-6e18bdc17300 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] No waiting events found dispatching network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:12:08 user nova-compute[72803]: WARNING nova.compute.manager [req-cb7d176c-74a1-4eaf-a9bb-62b550a69a15 req-de77aaa1-411a-46d6-83e8-6e18bdc17300 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received unexpected event network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 for instance with vm_state building and task_state spawning.
Aug 15 07:12:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083530.8426278, 8d0be6c9-8e93-4a50-bf2b-d287e619b303 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:12:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] VM Resumed (Lifecycle Event)
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:12:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Instance spawned successfully.
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:12:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083530.8459733, 8d0be6c9-8e93-4a50-bf2b-d287e619b303 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:12:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] VM Started (Lifecycle Event)
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:12:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-8248dc96-aa8f-45d6-b2e9-9a6a71e11a0f req-a8c07c63-e652-4798-a3b1-27538f05c668 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8248dc96-aa8f-45d6-b2e9-9a6a71e11a0f req-a8c07c63-e652-4798-a3b1-27538f05c668 service nova] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8248dc96-aa8f-45d6-b2e9-9a6a71e11a0f req-a8c07c63-e652-4798-a3b1-27538f05c668 service nova] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8248dc96-aa8f-45d6-b2e9-9a6a71e11a0f req-a8c07c63-e652-4798-a3b1-27538f05c668 service nova] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-8248dc96-aa8f-45d6-b2e9-9a6a71e11a0f req-a8c07c63-e652-4798-a3b1-27538f05c668 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] No waiting events found dispatching network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:12:10 user nova-compute[72803]: WARNING nova.compute.manager [req-8248dc96-aa8f-45d6-b2e9-9a6a71e11a0f req-a8c07c63-e652-4798-a3b1-27538f05c668 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received unexpected event network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 for instance with vm_state building and task_state spawning.
Aug 15 07:12:10 user nova-compute[72803]: INFO nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 15 07:12:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:12:11 user nova-compute[72803]: INFO nova.compute.manager [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Took 6.90 seconds to build instance.
Aug 15 07:12:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b58d2e53-5bc9-464f-b078-f8b04b84c8d6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.053s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_power_states {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 0777bcb5-966e-424a-8732-e53c6352183e {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid c2c458fd-fdc5-43df-a7c2-f53463a33119 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid f43c9933-39ab-4d03-a399-d4014456de91 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "0777bcb5-966e-424a-8732-e53c6352183e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "f43c9933-39ab-4d03-a399-d4014456de91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "f43c9933-39ab-4d03-a399-d4014456de91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "0777bcb5-966e-424a-8732-e53c6352183e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "f43c9933-39ab-4d03-a399-d4014456de91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:28 user nova-compute[72803]: INFO nova.compute.manager [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Terminating instance
Aug 15 07:12:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-06b18479-162b-4c9e-a721-1ee69622a69d req-01700791-12a1-42c2-bf83-e4b3a8cbc9bc service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-06b18479-162b-4c9e-a721-1ee69622a69d req-01700791-12a1-42c2-bf83-e4b3a8cbc9bc service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-06b18479-162b-4c9e-a721-1ee69622a69d req-01700791-12a1-42c2-bf83-e4b3a8cbc9bc service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-06b18479-162b-4c9e-a721-1ee69622a69d req-01700791-12a1-42c2-bf83-e4b3a8cbc9bc service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-06b18479-162b-4c9e-a721-1ee69622a69d req-01700791-12a1-42c2-bf83-e4b3a8cbc9bc service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:12:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-06b18479-162b-4c9e-a721-1ee69622a69d req-01700791-12a1-42c2-bf83-e4b3a8cbc9bc service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-unplugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:12:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Instance destroyed successfully.
Aug 15 07:12:29 user nova-compute[72803]: DEBUG nova.objects.instance [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'resources' on Instance uuid 549d5d40-8521-4a9b-abbd-f6319b5b393b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322158826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322158826',id=29,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:08:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-n98lymqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:10:42Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=549d5d40-8521-4a9b-abbd-f6319b5b393b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "address": "fa:16:3e:ae:41:07", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5ebbd1-04", "ovs_interfaceid": "7f5ebbd1-04cb-44df-a1a0-fe9979075501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:41:07,bridge_name='br-int',has_traffic_filtering=True,id=7f5ebbd1-04cb-44df-a1a0-fe9979075501,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5ebbd1-04') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_vif [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:41:07,bridge_name='br-int',has_traffic_filtering=True,id=7f5ebbd1-04cb-44df-a1a0-fe9979075501,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5ebbd1-04') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f5ebbd1-04, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:12:29 user nova-compute[72803]: INFO os_vif [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:41:07,bridge_name='br-int',has_traffic_filtering=True,id=7f5ebbd1-04cb-44df-a1a0-fe9979075501,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5ebbd1-04')
Aug 15 07:12:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQoitgBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:12:29 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aaf408-deae-4f63-8373-7566e206d901]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abcb45c-d4bf-4505-be37-81b36930437c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:12:29 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:12:29 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:12:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:12:29 user nova-compute[72803]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b (non-flash)
Aug 15 07:12:29 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:12:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0529bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5564b3-39b8-47c2-b3fc-e00b030e09a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2fc57f-dc32-4200-8576-092ad660fd78]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[763a33a8-57b7-4be0-a51a-d5416e3a0746]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56916f3-6bc7-41a5-8951-bbf395e9dfd7]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe8938046-f791fc63b94b7fd7', '/dev/disk/by-id/scsi-26637393166633633', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e8938046') {{(pid=84151) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 07:12:29 user nova-compute[72803]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe8938046-f791fc63b94b7fd7
Aug 15 07:12:29 user nova-compute[72803]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26637393166633633
Aug 15 07:12:29 user nova-compute[72803]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e8938046
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0045b65-a5f7-4a16-bb80-5a31b03e2bbb]: (4, None) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f12bbb1-b7d1-462b-bd7c-85c04a5563f0]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9180dcbd-4a31-405f-ac79-6896b52ff58c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b, portal: 172.16.0.220,3260]
Aug 15 07:12:29 user nova-compute[72803]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b, portal: 172.16.0.220,3260] successful.
Aug 15 07:12:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65a376f5-1916-4ba2-a54e-da440b48eb1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3001f7-5ae7-4277-b49e-53e9d055a190]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] <== disconnect_volume: return (307ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:12:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Deleting instance files /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b_del
Aug 15 07:12:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Deletion of /opt/stack/data/nova/instances/549d5d40-8521-4a9b-abbd-f6319b5b393b_del complete
Aug 15 07:12:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:29 user nova-compute[72803]: INFO nova.compute.manager [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 15 07:12:29 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:12:29 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:12:30 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:12:30 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Took 0.54 seconds to deallocate network for instance.
Aug 15 07:12:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-2c23170d-ff2f-4957-9b60-d3561aa0adfe req-89e3111d-d5ac-455d-a90e-8c3d3fe103db service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-deleted-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:12:30 user nova-compute[72803]: INFO nova.compute.manager [req-2c23170d-ff2f-4957-9b60-d3561aa0adfe req-89e3111d-d5ac-455d-a90e-8c3d3fe103db service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Neutron deleted interface 7f5ebbd1-04cb-44df-a1a0-fe9979075501; detaching it from the instance and deleting it from the info cache
Aug 15 07:12:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-2c23170d-ff2f-4957-9b60-d3561aa0adfe req-89e3111d-d5ac-455d-a90e-8c3d3fe103db service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:12:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-2c23170d-ff2f-4957-9b60-d3561aa0adfe req-89e3111d-d5ac-455d-a90e-8c3d3fe103db service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Detach interface failed, port_id=7f5ebbd1-04cb-44df-a1a0-fe9979075501, reason: Instance 549d5d40-8521-4a9b-abbd-f6319b5b393b could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:12:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-271895b9-fcf3-4512-b02b-c16233807e8f req-980a6074-9020-4be5-b5b5-8c80d8dfe4b0 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:12:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-271895b9-fcf3-4512-b02b-c16233807e8f req-980a6074-9020-4be5-b5b5-8c80d8dfe4b0 service nova] Acquiring lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-271895b9-fcf3-4512-b02b-c16233807e8f req-980a6074-9020-4be5-b5b5-8c80d8dfe4b0 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-271895b9-fcf3-4512-b02b-c16233807e8f req-980a6074-9020-4be5-b5b5-8c80d8dfe4b0 service nova] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-271895b9-fcf3-4512-b02b-c16233807e8f req-980a6074-9020-4be5-b5b5-8c80d8dfe4b0 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] No waiting events found dispatching network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:12:30 user nova-compute[72803]: WARNING nova.compute.manager [req-271895b9-fcf3-4512-b02b-c16233807e8f req-980a6074-9020-4be5-b5b5-8c80d8dfe4b0 service nova] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Received unexpected event network-vif-plugged-7f5ebbd1-04cb-44df-a1a0-fe9979075501 for instance with vm_state active and task_state deleting.
Aug 15 07:12:31 user nova-compute[72803]: INFO nova.compute.manager [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Took 0.85 seconds to detach 1 volumes for instance.
Aug 15 07:12:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:31 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:12:31 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:12:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:31 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Deleted allocations for instance 549d5d40-8521-4a9b-abbd-f6319b5b393b
Aug 15 07:12:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-9e18f7dd-1e5e-4f42-a7cc-1c15c25afe7e tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "549d5d40-8521-4a9b-abbd-f6319b5b393b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:36 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:37 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:42 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:42 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:12:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:12:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:12:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:44 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083549.195437, 549d5d40-8521-4a9b-abbd-f6319b5b393b => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:12:44 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] VM Stopped (Lifecycle Event)
Aug 15 07:12:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-66664e1d-2869-4067-9449-83ce4ae07e1f None None] [instance: 549d5d40-8521-4a9b-abbd-f6319b5b393b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:12:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:49 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:12:49 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=25.211849212646484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance c2c458fd-fdc5-43df-a7c2-f53463a33119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f43c9933-39ab-4d03-a399-d4014456de91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:12:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:54 user nova-compute[72803]: INFO nova.compute.manager [None req-af7c0df4-4d3f-45bc-9cea-ab744eb05f60 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Get console output
Aug 15 07:12:54 user nova-compute[72803]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 07:12:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "39617700-3648-4f38-b129-0c71584828c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:12:57 user nova-compute[72803]: INFO nova.compute.claims [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Claim successful on node user
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:12:57 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.policy [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cf4a499a9d54262bd8959b87918717c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa8ac0862d14e7792d6c03f46c170ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:12:57 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Creating image(s)
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-45e8bbc3-bf08-400d-8175-0626ba8af35a req-a20ec024-7d71-4c75-b1bf-dce785b08979 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-changed-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-45e8bbc3-bf08-400d-8175-0626ba8af35a req-a20ec024-7d71-4c75-b1bf-dce785b08979 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Refreshing instance network info cache due to event network-changed-3a972661-dcbf-44be-91a3-f74578045e98. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-45e8bbc3-bf08-400d-8175-0626ba8af35a req-a20ec024-7d71-4c75-b1bf-dce785b08979 service nova] Acquiring lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-45e8bbc3-bf08-400d-8175-0626ba8af35a req-a20ec024-7d71-4c75-b1bf-dce785b08979 service nova] Acquired lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-45e8bbc3-bf08-400d-8175-0626ba8af35a req-a20ec024-7d71-4c75-b1bf-dce785b08979 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Refreshing network info cache for port 3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:12:58 user nova-compute[72803]: INFO nova.compute.claims [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Claim successful on node user
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk 1073741824" returned: 0 in 0.061s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.214s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Successfully created port: 98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-45e8bbc3-bf08-400d-8175-0626ba8af35a req-a20ec024-7d71-4c75-b1bf-dce785b08979 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Updated VIF entry in instance network info cache for port 3a972661-dcbf-44be-91a3-f74578045e98. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-45e8bbc3-bf08-400d-8175-0626ba8af35a req-a20ec024-7d71-4c75-b1bf-dce785b08979 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Updating instance_info_cache with network_info: [{"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-45e8bbc3-bf08-400d-8175-0626ba8af35a req-a20ec024-7d71-4c75-b1bf-dce785b08979 service nova] Releasing lock "refresh_cache-7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Cannot resize image /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.objects.instance [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'migration_context' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Ensure instance console log exists: /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:12:58 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.policy [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cf4a499a9d54262bd8959b87918717c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa8ac0862d14e7792d6c03f46c170ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:12:58 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Creating image(s)
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk 1073741824" returned: 0 in 0.052s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Successfully created port: 7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Successfully updated port: 98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquired lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Cannot resize image /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'migration_context' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Ensure instance console log exists: /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-fe98656b-a56c-40aa-bb65-4ab0d503b532 req-e487b8ef-1d31-4c02-b7ee-0e54a1a1a3c0 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-changed-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-fe98656b-a56c-40aa-bb65-4ab0d503b532 req-e487b8ef-1d31-4c02-b7ee-0e54a1a1a3c0 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Refreshing instance network info cache due to event network-changed-98e86640-e22c-4601-a1d7-6ed0ddf79cd2. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fe98656b-a56c-40aa-bb65-4ab0d503b532 req-e487b8ef-1d31-4c02-b7ee-0e54a1a1a3c0 service nova] Acquiring lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Releasing lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance network_info: |[{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fe98656b-a56c-40aa-bb65-4ab0d503b532 req-e487b8ef-1d31-4c02-b7ee-0e54a1a1a3c0 service nova] Acquired lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-fe98656b-a56c-40aa-bb65-4ab0d503b532 req-e487b8ef-1d31-4c02-b7ee-0e54a1a1a3c0 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Refreshing network info cache for port 98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Start _get_guest_xml network_info=[{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:12:59 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:12:59 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:12:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-622417303',display_name='tempest-ServerRescueNegativeTestJSON-server-622417303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-622417303',id=35,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-rhfwcjxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:12:58Z,user_data=None,user_id='0cf4a499a9d54262bd8959b87918717c',uuid=39617700-3648-4f38-b129-0c71584828c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e86640-e2') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'pci_devices' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:13:00 user nova-compute[72803]:   <uuid>39617700-3648-4f38-b129-0c71584828c9</uuid>
Aug 15 07:13:00 user nova-compute[72803]:   <name>instance-00000023</name>
Aug 15 07:13:00 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:13:00 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:13:00 user nova-compute[72803]:   <metadata>
Aug 15 07:13:00 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:13:00 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-622417303</nova:name>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:12:59</nova:creationTime>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:13:00 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:13:00 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:owner>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:user uuid="0cf4a499a9d54262bd8959b87918717c">tempest-ServerRescueNegativeTestJSON-1974019782-project-member</nova:user>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:project uuid="eaa8ac0862d14e7792d6c03f46c170ba">tempest-ServerRescueNegativeTestJSON-1974019782</nova:project>
Aug 15 07:13:00 user nova-compute[72803]:       </nova:owner>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:ports>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:port uuid="98e86640-e22c-4601-a1d7-6ed0ddf79cd2">
Aug 15 07:13:00 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 07:13:00 user nova-compute[72803]:         </nova:port>
Aug 15 07:13:00 user nova-compute[72803]:       </nova:ports>
Aug 15 07:13:00 user nova-compute[72803]:     </nova:instance>
Aug 15 07:13:00 user nova-compute[72803]:   </metadata>
Aug 15 07:13:00 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:13:00 user nova-compute[72803]:     <system>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="serial">39617700-3648-4f38-b129-0c71584828c9</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="uuid">39617700-3648-4f38-b129-0c71584828c9</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:13:00 user nova-compute[72803]:     </system>
Aug 15 07:13:00 user nova-compute[72803]:   </sysinfo>
Aug 15 07:13:00 user nova-compute[72803]:   <os>
Aug 15 07:13:00 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:13:00 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:13:00 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:13:00 user nova-compute[72803]:   </os>
Aug 15 07:13:00 user nova-compute[72803]:   <features>
Aug 15 07:13:00 user nova-compute[72803]:     <acpi/>
Aug 15 07:13:00 user nova-compute[72803]:     <apic/>
Aug 15 07:13:00 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:13:00 user nova-compute[72803]:   </features>
Aug 15 07:13:00 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:13:00 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:13:00 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:13:00 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:13:00 user nova-compute[72803]:   </clock>
Aug 15 07:13:00 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:13:00 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:13:00 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:13:00 user nova-compute[72803]:   </cpu>
Aug 15 07:13:00 user nova-compute[72803]:   <devices>
Aug 15 07:13:00 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:13:00 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:13:00 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk"/>
Aug 15 07:13:00 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:13:00 user nova-compute[72803]:     </disk>
Aug 15 07:13:00 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:13:00 user nova-compute[72803]:       <mac address="fa:16:3e:56:c4:5a"/>
Aug 15 07:13:00 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:13:00 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:13:00 user nova-compute[72803]:       <target dev="tap98e86640-e2"/>
Aug 15 07:13:00 user nova-compute[72803]:     </interface>
Aug 15 07:13:00 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:13:00 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/console.log" append="off"/>
Aug 15 07:13:00 user nova-compute[72803]:     </serial>
Aug 15 07:13:00 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:13:00 user nova-compute[72803]:     <video>
Aug 15 07:13:00 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:13:00 user nova-compute[72803]:     </video>
Aug 15 07:13:00 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:13:00 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:13:00 user nova-compute[72803]:     </rng>
Aug 15 07:13:00 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:13:00 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:13:00 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:13:00 user nova-compute[72803]:     </memballoon>
Aug 15 07:13:00 user nova-compute[72803]:   </devices>
Aug 15 07:13:00 user nova-compute[72803]: </domain>
Aug 15 07:13:00 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-622417303',display_name='tempest-ServerRescueNegativeTestJSON-server-622417303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-622417303',id=35,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-rhfwcjxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:12:58Z,user_data=None,user_id='0cf4a499a9d54262bd8959b87918717c',uuid=39617700-3648-4f38-b129-0c71584828c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e86640-e2') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG os_vif [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e86640-e2') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98e86640-e2, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98e86640-e2, col_values=(('external_ids', {'iface-id': '98e86640-e22c-4601-a1d7-6ed0ddf79cd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:c4:5a', 'vm-uuid': '39617700-3648-4f38-b129-0c71584828c9'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:00 user nova-compute[72803]: INFO os_vif [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e86640-e2')
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No VIF found with MAC fa:16:3e:56:c4:5a, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Successfully updated port: 7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquired lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-054f8e72-afed-4212-9b5e-06138fafa10b req-48ce2110-e37a-41ba-ac71-7534cbb8424b service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-changed-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-054f8e72-afed-4212-9b5e-06138fafa10b req-48ce2110-e37a-41ba-ac71-7534cbb8424b service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Refreshing instance network info cache due to event network-changed-7286db1d-0212-4863-acff-f1206f583449. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-054f8e72-afed-4212-9b5e-06138fafa10b req-48ce2110-e37a-41ba-ac71-7534cbb8424b service nova] Acquiring lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-fe98656b-a56c-40aa-bb65-4ab0d503b532 req-e487b8ef-1d31-4c02-b7ee-0e54a1a1a3c0 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updated VIF entry in instance network info cache for port 98e86640-e22c-4601-a1d7-6ed0ddf79cd2. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-fe98656b-a56c-40aa-bb65-4ab0d503b532 req-e487b8ef-1d31-4c02-b7ee-0e54a1a1a3c0 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fe98656b-a56c-40aa-bb65-4ab0d503b532 req-e487b8ef-1d31-4c02-b7ee-0e54a1a1a3c0 service nova] Releasing lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updating instance_info_cache with network_info: [{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Releasing lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Instance network_info: |[{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-054f8e72-afed-4212-9b5e-06138fafa10b req-48ce2110-e37a-41ba-ac71-7534cbb8424b service nova] Acquired lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-054f8e72-afed-4212-9b5e-06138fafa10b req-48ce2110-e37a-41ba-ac71-7534cbb8424b service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Refreshing network info cache for port 7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Start _get_guest_xml network_info=[{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:13:00 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:13:00 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-553899271',display_name='tempest-ServerRescueNegativeTestJSON-server-553899271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-553899271',id=36,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-nyo082ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:12:59Z,user_data=None,user_id='0cf4a499a9d54262bd8959b87918717c',uuid=511e9555-52a0-4f2c-b4ff-0f68ba2c32be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d6:0a,bridge_name='br-int',has_traffic_filtering=True,id=7286db1d-0212-4863-acff-f1206f583449,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7286db1d-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'pci_devices' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:13:00 user nova-compute[72803]:   <uuid>511e9555-52a0-4f2c-b4ff-0f68ba2c32be</uuid>
Aug 15 07:13:00 user nova-compute[72803]:   <name>instance-00000024</name>
Aug 15 07:13:00 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:13:00 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:13:00 user nova-compute[72803]:   <metadata>
Aug 15 07:13:00 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:13:00 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-553899271</nova:name>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:13:00</nova:creationTime>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:13:00 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:13:00 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:owner>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:user uuid="0cf4a499a9d54262bd8959b87918717c">tempest-ServerRescueNegativeTestJSON-1974019782-project-member</nova:user>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:project uuid="eaa8ac0862d14e7792d6c03f46c170ba">tempest-ServerRescueNegativeTestJSON-1974019782</nova:project>
Aug 15 07:13:00 user nova-compute[72803]:       </nova:owner>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:13:00 user nova-compute[72803]:       <nova:ports>
Aug 15 07:13:00 user nova-compute[72803]:         <nova:port uuid="7286db1d-0212-4863-acff-f1206f583449">
Aug 15 07:13:00 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:13:00 user nova-compute[72803]:         </nova:port>
Aug 15 07:13:00 user nova-compute[72803]:       </nova:ports>
Aug 15 07:13:00 user nova-compute[72803]:     </nova:instance>
Aug 15 07:13:00 user nova-compute[72803]:   </metadata>
Aug 15 07:13:00 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:13:00 user nova-compute[72803]:     <system>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="serial">511e9555-52a0-4f2c-b4ff-0f68ba2c32be</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="uuid">511e9555-52a0-4f2c-b4ff-0f68ba2c32be</entry>
Aug 15 07:13:00 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:13:00 user nova-compute[72803]:     </system>
Aug 15 07:13:00 user nova-compute[72803]:   </sysinfo>
Aug 15 07:13:00 user nova-compute[72803]:   <os>
Aug 15 07:13:00 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:13:00 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:13:00 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:13:00 user nova-compute[72803]:   </os>
Aug 15 07:13:00 user nova-compute[72803]:   <features>
Aug 15 07:13:00 user nova-compute[72803]:     <acpi/>
Aug 15 07:13:00 user nova-compute[72803]:     <apic/>
Aug 15 07:13:00 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:13:00 user nova-compute[72803]:   </features>
Aug 15 07:13:00 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:13:00 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:13:00 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:13:00 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:13:00 user nova-compute[72803]:   </clock>
Aug 15 07:13:00 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:13:00 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:13:00 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:13:00 user nova-compute[72803]:   </cpu>
Aug 15 07:13:00 user nova-compute[72803]:   <devices>
Aug 15 07:13:00 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:13:00 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:13:00 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk"/>
Aug 15 07:13:00 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:13:00 user nova-compute[72803]:     </disk>
Aug 15 07:13:00 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:13:00 user nova-compute[72803]:       <mac address="fa:16:3e:07:d6:0a"/>
Aug 15 07:13:00 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:13:00 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:13:00 user nova-compute[72803]:       <target dev="tap7286db1d-02"/>
Aug 15 07:13:00 user nova-compute[72803]:     </interface>
Aug 15 07:13:00 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:13:00 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/console.log" append="off"/>
Aug 15 07:13:00 user nova-compute[72803]:     </serial>
Aug 15 07:13:00 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:13:00 user nova-compute[72803]:     <video>
Aug 15 07:13:00 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:13:00 user nova-compute[72803]:     </video>
Aug 15 07:13:00 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:13:00 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:13:00 user nova-compute[72803]:     </rng>
Aug 15 07:13:00 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:13:00 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:13:00 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:13:00 user nova-compute[72803]:     </memballoon>
Aug 15 07:13:00 user nova-compute[72803]:   </devices>
Aug 15 07:13:00 user nova-compute[72803]: </domain>
Aug 15 07:13:00 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-553899271',display_name='tempest-ServerRescueNegativeTestJSON-server-553899271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-553899271',id=36,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-nyo082ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:12:59Z,user_data=None,user_id='0cf4a499a9d54262bd8959b87918717c',uuid=511e9555-52a0-4f2c-b4ff-0f68ba2c32be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d6:0a,bridge_name='br-int',has_traffic_filtering=True,id=7286db1d-0212-4863-acff-f1206f583449,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7286db1d-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG os_vif [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d6:0a,bridge_name='br-int',has_traffic_filtering=True,id=7286db1d-0212-4863-acff-f1206f583449,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7286db1d-02') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7286db1d-02, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7286db1d-02, col_values=(('external_ids', {'iface-id': '7286db1d-0212-4863-acff-f1206f583449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:d6:0a', 'vm-uuid': '511e9555-52a0-4f2c-b4ff-0f68ba2c32be'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:00 user nova-compute[72803]: INFO os_vif [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d6:0a,bridge_name='br-int',has_traffic_filtering=True,id=7286db1d-0212-4863-acff-f1206f583449,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7286db1d-02')
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:13:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No VIF found with MAC fa:16:3e:07:d6:0a, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-054f8e72-afed-4212-9b5e-06138fafa10b req-48ce2110-e37a-41ba-ac71-7534cbb8424b service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updated VIF entry in instance network info cache for port 7286db1d-0212-4863-acff-f1206f583449. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-054f8e72-afed-4212-9b5e-06138fafa10b req-48ce2110-e37a-41ba-ac71-7534cbb8424b service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updating instance_info_cache with network_info: [{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-054f8e72-afed-4212-9b5e-06138fafa10b req-48ce2110-e37a-41ba-ac71-7534cbb8424b service nova] Releasing lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:01 user nova-compute[72803]: INFO nova.compute.manager [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Attaching volume dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c to /dev/vdb
Aug 15 07:13:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG os_brick.utils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5497d521-9b1e-4e36-9072-50e3349ebfb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c8973-d30e-4be6-8cc8-c112a4cf7896]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519f1f1-57f2-48e9-982d-b18702b5a146]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b27f157-2314-4cb7-a012-87e56e050f1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:13:01 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:13:01 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92757ae-9f85-4507-8585-2836f942d1d2]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG os_brick.utils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:13:01 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Updating existing volume attachment record: b1be8b08-b19e-40f4-863e-8dbc57eeca79 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-ac03d82b-43f6-484a-aab6-2d753385c279 req-7e1e9784-8b2c-441f-b6b7-90f3f7fa4f8d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac03d82b-43f6-484a-aab6-2d753385c279 req-7e1e9784-8b2c-441f-b6b7-90f3f7fa4f8d service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac03d82b-43f6-484a-aab6-2d753385c279 req-7e1e9784-8b2c-441f-b6b7-90f3f7fa4f8d service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ac03d82b-43f6-484a-aab6-2d753385c279 req-7e1e9784-8b2c-441f-b6b7-90f3f7fa4f8d service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-ac03d82b-43f6-484a-aab6-2d753385c279 req-7e1e9784-8b2c-441f-b6b7-90f3f7fa4f8d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:02 user nova-compute[72803]: WARNING nova.compute.manager [req-ac03d82b-43f6-484a-aab6-2d753385c279 req-7e1e9784-8b2c-441f-b6b7-90f3f7fa4f8d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state building and task_state spawning.
Aug 15 07:13:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:05 user nova-compute[72803]: WARNING nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state building and task_state spawning.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] No waiting events found dispatching network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:05 user nova-compute[72803]: WARNING nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received unexpected event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 for instance with vm_state building and task_state spawning.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] No waiting events found dispatching network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:05 user nova-compute[72803]: WARNING nova.compute.manager [req-051a7e1c-a95d-43a1-b976-72161089e08e req-f40bc7b1-0b16-4c84-b654-a2b779a5b2de service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received unexpected event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 for instance with vm_state building and task_state spawning.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083585.0714943, 39617700-3648-4f38-b129-0c71584828c9 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] VM Resumed (Lifecycle Event)
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance spawned successfully.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083585.0739753, 39617700-3648-4f38-b129-0c71584828c9 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] VM Started (Lifecycle Event)
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Instance spawned successfully.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083585.1095974, 511e9555-52a0-4f2c-b4ff-0f68ba2c32be => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] VM Resumed (Lifecycle Event)
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Took 7.52 seconds to spawn the instance on the hypervisor.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083585.1099243, 511e9555-52a0-4f2c-b4ff-0f68ba2c32be => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] VM Started (Lifecycle Event)
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Took 8.25 seconds to build instance.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ace0a45a-679b-4fe7-af8e-43b679039344 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "39617700-3648-4f38-b129-0c71584828c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.352s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:13:05 user nova-compute[72803]: INFO nova.compute.manager [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Took 7.38 seconds to build instance.
Aug 15 07:13:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c7d75f33-1a4b-4cc9-a936-cca6b2a08e59 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.536s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TWeqREft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:13:11 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:13:11 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:13:11 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed622dd9-279d-4807-b2be-28585dd5851d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:13:11 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c789da-69da-45d0-9b9b-dbf9c64492ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c] added
Aug 15 07:13:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86678b4-fa68-4f22-86f7-84c5da0bbbb7]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[237c1c09-c723-44df-bf61-a690e56051a7]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TWeqREft {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TWeqREft" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[df033091-c2d5-4441-8636-7edd4c0c2d4c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TWeqREft'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[630b3912-fcbf-4d60-af98-18d20f31fb8f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1729cfb4-0006-4745-beef-1f9af9f183fe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:11 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:11 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96cadcb-4917-41ea-ab18-68ed2906521e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c, portal: 172.16.0.220,3260]
Aug 15 07:13:11 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c, portal: 172.16.0.220,3260] successful.
Aug 15 07:13:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf4ed72-6594-4ae1-8e97-377812d826c6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea4a30-5243-4723-a96c-5fd53e173f30]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:11 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:11 user nova-compute[72803]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)
Aug 15 07:13:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:11 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:11 user nova-compute[72803]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)
Aug 15 07:13:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f254d85c-e98a-4427-b12f-76c6d7937813]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:13:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TWeqREft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:13:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:13:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23132393438613934', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:13:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132393438613934', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:13:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:13:12 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:13:12 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:13:12 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:13:12 user nova-compute[72803]:   <serial>dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c</serial>
Aug 15 07:13:12 user nova-compute[72803]: </disk>
Aug 15 07:13:12 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:13:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:13:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:13:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No VIF found with MAC fa:16:3e:b2:9a:83, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:13:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-6d0aa06c-9f34-4061-a7d2-a54e92a6549e tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.597s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:17 user nova-compute[72803]: INFO nova.compute.manager [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Attaching volume 5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d to /dev/vdc
Aug 15 07:13:17 user nova-compute[72803]: DEBUG os_brick.utils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[467fe31b-2035-475b-9546-bb173e8576d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfbf0ba-2375-4db1-9fda-e4df38752877]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7974daa-ff03-44f4-96fb-ac4b8b094e58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6327a6b2-74b2-445d-934a-276c092d156b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:13:17 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:13:17 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6145d4e2-ba00-4a88-b155-ff7167255fa9]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG os_brick.utils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:13:17 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Updating existing volume attachment record: 765290a5-0663-4f72-b95c-fedc711c9d22 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:19 user nova-compute[72803]: INFO nova.compute.manager [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Terminating instance
Aug 15 07:13:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-275f42dd-3058-437d-ab56-c0cbe37948a7 req-297e18f6-cbd1-4b80-9582-53f957712830 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received event network-vif-unplugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-275f42dd-3058-437d-ab56-c0cbe37948a7 req-297e18f6-cbd1-4b80-9582-53f957712830 service nova] Acquiring lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-275f42dd-3058-437d-ab56-c0cbe37948a7 req-297e18f6-cbd1-4b80-9582-53f957712830 service nova] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-275f42dd-3058-437d-ab56-c0cbe37948a7 req-297e18f6-cbd1-4b80-9582-53f957712830 service nova] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-275f42dd-3058-437d-ab56-c0cbe37948a7 req-297e18f6-cbd1-4b80-9582-53f957712830 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] No waiting events found dispatching network-vif-unplugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-275f42dd-3058-437d-ab56-c0cbe37948a7 req-297e18f6-cbd1-4b80-9582-53f957712830 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received event network-vif-unplugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:13:19 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Instance destroyed successfully.
Aug 15 07:13:19 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'resources' on Instance uuid c2c458fd-fdc5-43df-a7c2-f53463a33119 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1418865815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1418865815',id=26,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-booj14nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:05:52Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=c2c458fd-fdc5-43df-a7c2-f53463a33119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "address": "fa:16:3e:c9:fc:4f", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea738c65-7a", "ovs_interfaceid": "ea738c65-7aa6-4796-971f-7047ee6c6a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:fc:4f,bridge_name='br-int',has_traffic_filtering=True,id=ea738c65-7aa6-4796-971f-7047ee6c6a37,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea738c65-7a') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG os_vif [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:fc:4f,bridge_name='br-int',has_traffic_filtering=True,id=ea738c65-7aa6-4796-971f-7047ee6c6a37,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea738c65-7a') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea738c65-7a, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:19 user nova-compute[72803]: INFO os_vif [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:fc:4f,bridge_name='br-int',has_traffic_filtering=True,id=ea738c65-7aa6-4796-971f-7047ee6c6a37,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea738c65-7a')
Aug 15 07:13:19 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Deleting instance files /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119_del
Aug 15 07:13:19 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Deletion of /opt/stack/data/nova/instances/c2c458fd-fdc5-43df-a7c2-f53463a33119_del complete
Aug 15 07:13:20 user nova-compute[72803]: INFO nova.compute.manager [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 15 07:13:20 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:13:20 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:13:20 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:13:20 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:20 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Took 0.51 seconds to deallocate network for instance.
Aug 15 07:13:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-3ffa885f-6e53-49b1-8829-3f4f69ac877c req-58496eda-5378-4607-9663-1958ea7be0b0 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received event network-vif-deleted-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:20 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:13:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:13:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:20 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Deleted allocations for instance c2c458fd-fdc5-43df-a7c2-f53463a33119
Aug 15 07:13:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cbbf8314-cb79-4e20-bdd3-93a2e514f506 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.700s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-04e7e461-e080-41fc-977e-87cb99310b23 req-138564cd-6dd1-49d1-b01b-e39de05ddf75 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received event network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-04e7e461-e080-41fc-977e-87cb99310b23 req-138564cd-6dd1-49d1-b01b-e39de05ddf75 service nova] Acquiring lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-04e7e461-e080-41fc-977e-87cb99310b23 req-138564cd-6dd1-49d1-b01b-e39de05ddf75 service nova] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-04e7e461-e080-41fc-977e-87cb99310b23 req-138564cd-6dd1-49d1-b01b-e39de05ddf75 service nova] Lock "c2c458fd-fdc5-43df-a7c2-f53463a33119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-04e7e461-e080-41fc-977e-87cb99310b23 req-138564cd-6dd1-49d1-b01b-e39de05ddf75 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] No waiting events found dispatching network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:21 user nova-compute[72803]: WARNING nova.compute.manager [req-04e7e461-e080-41fc-977e-87cb99310b23 req-138564cd-6dd1-49d1-b01b-e39de05ddf75 service nova] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Received unexpected event network-vif-plugged-ea738c65-7aa6-4796-971f-7047ee6c6a37 for instance with vm_state deleted and task_state None.
Aug 15 07:13:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFUzQYxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:13:26 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:13:26 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:13:26 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fa14eb-fcaf-4a74-836a-de4ab38f29a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:13:26 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "f43c9933-39ab-4d03-a399-d4014456de91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f43c9933-39ab-4d03-a399-d4014456de91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "f43c9933-39ab-4d03-a399-d4014456de91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:26 user nova-compute[72803]: INFO nova.compute.manager [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Terminating instance
Aug 15 07:13:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede7a127-e487-486d-a329-fe7a03d8fe4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d] added
Aug 15 07:13:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b65cf9-5f42-4c82-9ab4-7a73104b7652]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd428fd-9311-465c-8ebe-ccc6a928081b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFUzQYxL {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFUzQYxL" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf27624-55a7-4e10-af39-94a1b9d0a827]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFUzQYxL'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4ca00f-b540-45e0-9074-dd57f0609426]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca84e651-7b9f-4caa-814f-0bf148d6a8f6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:26 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:26 user nova-compute[72803]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)
Aug 15 07:13:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:26 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:26 user nova-compute[72803]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)
Aug 15 07:13:26 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b915ab8-8eaa-4fa9-a40f-4df7b21fd38f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d, portal: 172.16.0.220,3260]
Aug 15 07:13:27 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d, portal: 172.16.0.220,3260] successful.
Aug 15 07:13:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54ed720-c4f3-47d8-8059-09dc6d328485]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43efd61c-5108-416d-ac9c-da53485dec96]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:27 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:27 user nova-compute[72803]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)
Aug 15 07:13:27 user nova-compute[72803]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)
Aug 15 07:13:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:27 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:27 user nova-compute[72803]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)
Aug 15 07:13:27 user nova-compute[72803]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)
Aug 15 07:13:27 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-8308ad01-6b65-499c-b2b1-1282c0f19d3b req-0d3e1716-4043-4cfe-9f6c-09bc03af4ca6 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received event network-vif-unplugged-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8308ad01-6b65-499c-b2b1-1282c0f19d3b req-0d3e1716-4043-4cfe-9f6c-09bc03af4ca6 service nova] Acquiring lock "f43c9933-39ab-4d03-a399-d4014456de91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8308ad01-6b65-499c-b2b1-1282c0f19d3b req-0d3e1716-4043-4cfe-9f6c-09bc03af4ca6 service nova] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8308ad01-6b65-499c-b2b1-1282c0f19d3b req-0d3e1716-4043-4cfe-9f6c-09bc03af4ca6 service nova] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-8308ad01-6b65-499c-b2b1-1282c0f19d3b req-0d3e1716-4043-4cfe-9f6c-09bc03af4ca6 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] No waiting events found dispatching network-vif-unplugged-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-8308ad01-6b65-499c-b2b1-1282c0f19d3b req-0d3e1716-4043-4cfe-9f6c-09bc03af4ca6 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received event network-vif-unplugged-c5794532-679e-4b77-95c0-ac4315d6d9be for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1442bbf-752e-4268-a530-e795f33f5707]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFUzQYxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Instance destroyed successfully.
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.objects.instance [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lazy-loading 'resources' on Instance uuid f43c9933-39ab-4d03-a399-d4014456de91 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-690669247',display_name='tempest-VolumesActionsTest-instance-690669247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-690669247',id=33,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:11:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c703e687f99045339795915d5dff031e',ramdisk_id='',reservation_id='r-p3rcxeem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1941402153',owner_user_name='tempest-VolumesActionsTest-1941402153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:11:44Z,user_data=None,user_id='9b510bc4a21940ae904886cfeaa8e29f',uuid=f43c9933-39ab-4d03-a399-d4014456de91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converting VIF {"id": "c5794532-679e-4b77-95c0-ac4315d6d9be", "address": "fa:16:3e:6f:cf:3f", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5794532-67", "ovs_interfaceid": "c5794532-679e-4b77-95c0-ac4315d6d9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5794532-679e-4b77-95c0-ac4315d6d9be,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5794532-67') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG os_vif [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5794532-679e-4b77-95c0-ac4315d6d9be,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5794532-67') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5794532-67, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:13:27 user nova-compute[72803]: INFO os_vif [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:cf:3f,bridge_name='br-int',has_traffic_filtering=True,id=c5794532-679e-4b77-95c0-ac4315d6d9be,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5794532-67')
Aug 15 07:13:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Deleting instance files /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91_del
Aug 15 07:13:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Deletion of /opt/stack/data/nova/instances/f43c9933-39ab-4d03-a399-d4014456de91_del complete
Aug 15 07:13:27 user nova-compute[72803]: INFO nova.compute.manager [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 15 07:13:27 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: f43c9933-39ab-4d03-a399-d4014456de91] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:27 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Took 0.52 seconds to deallocate network for instance.
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-31b8b6ec-7f51-415c-ab4a-87f423d1f9fd req-03958122-0b24-41db-b2c5-c4deb86c3ebc service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received event network-vif-deleted-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:27 user nova-compute[72803]: INFO nova.compute.manager [req-31b8b6ec-7f51-415c-ab4a-87f423d1f9fd req-03958122-0b24-41db-b2c5-c4deb86c3ebc service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Neutron deleted interface c5794532-679e-4b77-95c0-ac4315d6d9be; detaching it from the instance and deleting it from the info cache
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.network.neutron [req-31b8b6ec-7f51-415c-ab4a-87f423d1f9fd req-03958122-0b24-41db-b2c5-c4deb86c3ebc service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-31b8b6ec-7f51-415c-ab4a-87f423d1f9fd req-03958122-0b24-41db-b2c5-c4deb86c3ebc service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Detach interface failed, port_id=c5794532-679e-4b77-95c0-ac4315d6d9be, reason: Instance f43c9933-39ab-4d03-a399-d4014456de91 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26634666363666538', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634666363666538', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:13:28 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:13:28 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:13:28 user nova-compute[72803]:   <target dev="vdc" bus="virtio"/>
Aug 15 07:13:28 user nova-compute[72803]:   <serial>5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d</serial>
Aug 15 07:13:28 user nova-compute[72803]: </disk>
Aug 15 07:13:28 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:28 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Deleted allocations for instance f43c9933-39ab-4d03-a399-d4014456de91
Aug 15 07:13:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-23e75f30-fc1b-4415-bd41-0c4a50e387fd tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f43c9933-39ab-4d03-a399-d4014456de91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.649s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] No VIF found with MAC fa:16:3e:b2:9a:83, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:13:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a6187557-11a6-4965-872f-c49b28a7b0fc tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.104s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-84ab2648-cfe4-41e4-839b-a7d0025a5e19 req-6d621c1c-501b-430d-9aa9-cb3a1cba3731 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received event network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-84ab2648-cfe4-41e4-839b-a7d0025a5e19 req-6d621c1c-501b-430d-9aa9-cb3a1cba3731 service nova] Acquiring lock "f43c9933-39ab-4d03-a399-d4014456de91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-84ab2648-cfe4-41e4-839b-a7d0025a5e19 req-6d621c1c-501b-430d-9aa9-cb3a1cba3731 service nova] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-84ab2648-cfe4-41e4-839b-a7d0025a5e19 req-6d621c1c-501b-430d-9aa9-cb3a1cba3731 service nova] Lock "f43c9933-39ab-4d03-a399-d4014456de91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-84ab2648-cfe4-41e4-839b-a7d0025a5e19 req-6d621c1c-501b-430d-9aa9-cb3a1cba3731 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] No waiting events found dispatching network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:29 user nova-compute[72803]: WARNING nova.compute.manager [req-84ab2648-cfe4-41e4-839b-a7d0025a5e19 req-6d621c1c-501b-430d-9aa9-cb3a1cba3731 service nova] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Received unexpected event network-vif-plugged-c5794532-679e-4b77-95c0-ac4315d6d9be for instance with vm_state deleted and task_state None.
Aug 15 07:13:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:29 user nova-compute[72803]: INFO nova.compute.manager [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Detaching volume dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c
Aug 15 07:13:29 user nova-compute[72803]: INFO nova.virt.block_device [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Attempting to driver detach volume dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c from mountpoint /dev/vdb
Aug 15 07:13:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Attempting to detach device vdb from instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:13:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:13:29 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:13:29 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:13:29 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:13:29 user nova-compute[72803]:   <serial>dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c</serial>
Aug 15 07:13:29 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:13:29 user nova-compute[72803]: </disk>
Aug 15 07:13:29 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:13:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully detached device vdb from instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 from the persistent domain config.
Aug 15 07:13:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:13:30 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:13:30 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:13:30 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:13:30 user nova-compute[72803]:   <serial>dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c</serial>
Aug 15 07:13:30 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:13:30 user nova-compute[72803]: </disk>
Aug 15 07:13:30 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083610.430456, 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:13:30 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully detached device vdb from instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 from the live domain config.
Aug 15 07:13:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TWeqREft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:13:30 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15725f6-0fb8-42a8-a6f1-6c4b9563669c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5861bdeb-41b4-40f1-9501-c7740010de92]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:30 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:30 user nova-compute[72803]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)
Aug 15 07:13:30 user nova-compute[72803]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)
Aug 15 07:13:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:30 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:30 user nova-compute[72803]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c (non-flash)
Aug 15 07:13:30 user nova-compute[72803]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)
Aug 15 07:13:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c077a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4278758-8a5b-471d-a341-3b29111d084e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a45346e-bfed-46cb-bcd0-a9a9d5991c9b]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a6624-b6e6-4ff7-8e6a-1a21ac1b41ad]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9176a3-67f8-4e2b-8d61-7901ac270036]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda581f4-f434-457c-b5b5-904d1bfb97cb]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[95646d24-9789-48c9-9550-0ad82a466f47]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c, portal: 172.16.0.220,3260]
Aug 15 07:13:30 user nova-compute[72803]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c, portal: 172.16.0.220,3260] successful.
Aug 15 07:13:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7b9fbe-fcd0-40cc-99ac-2660a6a0be5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc982c-3027-4f20-b080-5390787624b9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== disconnect_volume: return (274ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:13:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:13:31 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c52472d0-b1a1-41fc-97d3-9676fc8e57a1 tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:32 user nova-compute[72803]: INFO nova.compute.manager [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Detaching volume 5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d
Aug 15 07:13:32 user nova-compute[72803]: INFO nova.virt.block_device [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Attempting to driver detach volume 5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d from mountpoint /dev/vdc
Aug 15 07:13:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Attempting to detach device vdc from instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:13:32 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:13:32 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:13:32 user nova-compute[72803]:   <target dev="vdc" bus="virtio"/>
Aug 15 07:13:32 user nova-compute[72803]:   <serial>5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d</serial>
Aug 15 07:13:32 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 07:13:32 user nova-compute[72803]: </disk>
Aug 15 07:13:32 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully detached device vdc from instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 from the persistent domain config.
Aug 15 07:13:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:13:32 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:13:32 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:13:32 user nova-compute[72803]:   <target dev="vdc" bus="virtio"/>
Aug 15 07:13:32 user nova-compute[72803]:   <serial>5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d</serial>
Aug 15 07:13:32 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 07:13:32 user nova-compute[72803]: </disk>
Aug 15 07:13:32 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083612.7891963, 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:13:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully detached device vdc from instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 from the live domain config.
Aug 15 07:13:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFUzQYxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:13:32 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc90895-8eab-473f-a313-0c7b572f2305]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc8f213-2117-43ab-9085-6d7ccb49fc2b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:32 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:32 user nova-compute[72803]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)
Aug 15 07:13:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:32 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:32 user nova-compute[72803]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d (non-flash)
Aug 15 07:13:32 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05a9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c51a6e-04bf-453f-b158-62bf3905dcb3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3efedf-cb56-47a1-89cd-c38042d74569]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a78bf4f-a41c-4da3-9464-c46bb31c0b55]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[190d7833-c1bb-4be9-9510-b55fa5a6d523]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b4d934-99da-44ef-a8e3-578b99527d9f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eec8e4-4039-49c8-a6bc-1babc4cb60ed]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d, portal: 172.16.0.220,3260]
Aug 15 07:13:33 user nova-compute[72803]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d, portal: 172.16.0.220,3260] successful.
Aug 15 07:13:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c1a8b0d-89ce-4c0f-be45-b2aa42a14b5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[22594cb2-333a-4639-b4f7-d5516a0a579d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] <== disconnect_volume: return (269ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2374f9af-fc36-4f33-b36f-44d684f82a6a tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.556s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:34 user nova-compute[72803]: INFO nova.compute.manager [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Terminating instance
Aug 15 07:13:34 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083599.931859, c2c458fd-fdc5-43df-a7c2-f53463a33119 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:13:34 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] VM Stopped (Lifecycle Event)
Aug 15 07:13:34 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ca965345-80dc-4656-af36-8bb25f23663c None None] [instance: c2c458fd-fdc5-43df-a7c2-f53463a33119] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-374d2517-2c2c-4717-9e98-ec7273cf1b59 req-9f6f742a-2126-45d8-95b4-38257768212a service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-unplugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-374d2517-2c2c-4717-9e98-ec7273cf1b59 req-9f6f742a-2126-45d8-95b4-38257768212a service nova] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-374d2517-2c2c-4717-9e98-ec7273cf1b59 req-9f6f742a-2126-45d8-95b4-38257768212a service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-374d2517-2c2c-4717-9e98-ec7273cf1b59 req-9f6f742a-2126-45d8-95b4-38257768212a service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-374d2517-2c2c-4717-9e98-ec7273cf1b59 req-9f6f742a-2126-45d8-95b4-38257768212a service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] No waiting events found dispatching network-vif-unplugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-374d2517-2c2c-4717-9e98-ec7273cf1b59 req-9f6f742a-2126-45d8-95b4-38257768212a service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-unplugged-3a972661-dcbf-44be-91a3-f74578045e98 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Instance destroyed successfully.
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lazy-loading 'resources' on Instance uuid 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:11:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-588430485',display_name='tempest-AttachVolumeTestJSON-server-588430485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-588430485',id=32,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwRyZiKqD14x++a957wdcfmwomoKfT5Hqa1Fx+LjlhmsFgAghFnobZ5qlWhIh3iuZ4HjIFQqCdHb3Aj1WHZw1TqjFgDC12NG8XIOdTa7aIepvjAFZOAZ7SAjuK0jjCvag==',key_name='tempest-keypair-1726035006',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:11:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa20f14f0f14b6791cce17d3fec420d',ramdisk_id='',reservation_id='r-d35jg01a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-820469847',owner_user_name='tempest-AttachVolumeTestJSON-820469847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeef867bec97404e9bd1f9810b93ba29',uuid=7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converting VIF {"id": "3a972661-dcbf-44be-91a3-f74578045e98", "address": "fa:16:3e:b2:9a:83", "network": {"id": "481bbd7e-ce59-47b7-969e-873877bc1c45", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-301760076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa20f14f0f14b6791cce17d3fec420d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a972661-dc", "ovs_interfaceid": "3a972661-dcbf-44be-91a3-f74578045e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9a:83,bridge_name='br-int',has_traffic_filtering=True,id=3a972661-dcbf-44be-91a3-f74578045e98,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a972661-dc') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG os_vif [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9a:83,bridge_name='br-int',has_traffic_filtering=True,id=3a972661-dcbf-44be-91a3-f74578045e98,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a972661-dc') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a972661-dc, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:13:35 user nova-compute[72803]: INFO os_vif [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:9a:83,bridge_name='br-int',has_traffic_filtering=True,id=3a972661-dcbf-44be-91a3-f74578045e98,network=Network(481bbd7e-ce59-47b7-969e-873877bc1c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a972661-dc')
Aug 15 07:13:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Deleting instance files /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7_del
Aug 15 07:13:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Deletion of /opt/stack/data/nova/instances/7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7_del complete
Aug 15 07:13:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:35 user nova-compute[72803]: INFO nova.compute.manager [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 07:13:35 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:13:35 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:13:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:37 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Took 1.39 seconds to deallocate network for instance.
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-b2488d7e-c4bd-4b8c-9a7d-cdbe82a8b612 req-3724e8eb-067b-4402-91fe-0f3eb539617e service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-deleted-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] No waiting events found dispatching network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:37 user nova-compute[72803]: WARNING nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received unexpected event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 for instance with vm_state deleted and task_state None.
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] No waiting events found dispatching network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:37 user nova-compute[72803]: WARNING nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received unexpected event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 for instance with vm_state deleted and task_state None.
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] No waiting events found dispatching network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:37 user nova-compute[72803]: WARNING nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received unexpected event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 for instance with vm_state deleted and task_state None.
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-unplugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] No waiting events found dispatching network-vif-unplugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:37 user nova-compute[72803]: WARNING nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received unexpected event network-vif-unplugged-3a972661-dcbf-44be-91a3-f74578045e98 for instance with vm_state deleted and task_state None.
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Acquiring lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] No waiting events found dispatching network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:37 user nova-compute[72803]: WARNING nova.compute.manager [req-288a9a24-a674-4a5c-8b61-31ca297a93c9 req-f219ffe7-9d07-48a4-908d-4dc32721c594 service nova] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Received unexpected event network-vif-plugged-3a972661-dcbf-44be-91a3-f74578045e98 for instance with vm_state deleted and task_state None.
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:37 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Deleted allocations for instance 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7
Aug 15 07:13:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8608c39d-ab45-4abd-b451-7f4dba28762f tempest-AttachVolumeTestJSON-820469847 tempest-AttachVolumeTestJSON-820469847-project-member] Lock "7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.732s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:42 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083607.3388784, f43c9933-39ab-4d03-a399-d4014456de91 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:13:42 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: f43c9933-39ab-4d03-a399-d4014456de91] VM Stopped (Lifecycle Event)
Aug 15 07:13:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-25e070b3-e62d-4333-b7ee-53d93cd83727 None None] [instance: f43c9933-39ab-4d03-a399-d4014456de91] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:42 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:13:44 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:13:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:13:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:13:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:13:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:13:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:44 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updating instance_info_cache with network_info: [{"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-4074dae9-9d30-4b2a-b0c3-58e57088e4bd" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:13:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:13:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:13:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:48 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:13:48 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:13:48 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7882MB free_disk=25.332561492919922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:13:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a4a01678-2255-4fb5-a497-1ceaab81422a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 36431f5c-df19-4836-ae18-8e9f7ae8d066 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:13:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:50 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:13:50 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083615.6642818, 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:13:50 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] VM Stopped (Lifecycle Event)
Aug 15 07:13:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c5874b43-bbcb-49b7-be14-da93fb92507a None None] [instance: 7a9c440e-3ed4-4b4c-8117-eae2fb7aa3c7] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:13:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:13:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:13:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:13:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:13:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:13:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:55 user nova-compute[72803]: INFO nova.compute.manager [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Terminating instance
Aug 15 07:13:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-31cc14e5-d4fb-4fec-89f2-911339f123cb req-98469ee0-b804-48f7-93dd-c8a34060340d service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-unplugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-31cc14e5-d4fb-4fec-89f2-911339f123cb req-98469ee0-b804-48f7-93dd-c8a34060340d service nova] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-31cc14e5-d4fb-4fec-89f2-911339f123cb req-98469ee0-b804-48f7-93dd-c8a34060340d service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-31cc14e5-d4fb-4fec-89f2-911339f123cb req-98469ee0-b804-48f7-93dd-c8a34060340d service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-31cc14e5-d4fb-4fec-89f2-911339f123cb req-98469ee0-b804-48f7-93dd-c8a34060340d service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] No waiting events found dispatching network-vif-unplugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-31cc14e5-d4fb-4fec-89f2-911339f123cb req-98469ee0-b804-48f7-93dd-c8a34060340d service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-unplugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:13:56 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Instance destroyed successfully.
Aug 15 07:13:56 user nova-compute[72803]: DEBUG nova.objects.instance [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'resources' on Instance uuid 36431f5c-df19-4836-ae18-8e9f7ae8d066 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1694780471',display_name='tempest-ServerActionsTestOtherA-server-1694780471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1694780471',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:09:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-danqw2ac',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=36431f5c-df19-4836-ae18-8e9f7ae8d066,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "address": "fa:16:3e:a8:4c:68", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26906fc5-11", "ovs_interfaceid": "26906fc5-11d2-4df0-9f43-0a6df7e8de04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_vif [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26906fc5-11, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:13:56 user nova-compute[72803]: INFO os_vif [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:4c:68,bridge_name='br-int',has_traffic_filtering=True,id=26906fc5-11d2-4df0-9f43-0a6df7e8de04,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26906fc5-11')
Aug 15 07:13:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyqlsaTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:13:56 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[faddf23f-c309-4b01-8cb0-708ae6effe04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6745c9ff-4669-4dd4-a501-3a470aac7ef5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:56 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:13:56 user nova-compute[72803]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc (non-flash)
Aug 15 07:13:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3500047a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10afbfe7-c1b6-4179-948a-af05ade2cdb4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4362f7e1-6176-4cd3-9c01-35b5c54ed464]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa15e36-f279-4506-bee0-cf388a70733c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbf6f76-29d7-497a-ac1c-6baf06a72943]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23530636465623634', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_43177481', '/dev/disk/by-id/scsi-1SCST_BIO43177481-50cdeb6424cbd2f4') {{(pid=84151) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a129ab7-2d0d-458c-aada-5cb9db101330]: (4, None) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed68356-1aa5-4825-90d9-b3afb7bf05ac]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0ef810-1d32-4867-b0f3-2ecd4c3f13fb]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260]
Aug 15 07:13:56 user nova-compute[72803]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc, portal: 172.16.0.220,3260] successful.
Aug 15 07:13:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:739d0d35-77ef-4473-93c4-a7f1fe0171dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1815ee8e-1d34-4c85-ab93-addb74598cc1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] <== disconnect_volume: return (313ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:13:56 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Deleting instance files /opt/stack/data/nova/instances/36431f5c-df19-4836-ae18-8e9f7ae8d066_del
Aug 15 07:13:56 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Deletion of /opt/stack/data/nova/instances/36431f5c-df19-4836-ae18-8e9f7ae8d066_del complete
Aug 15 07:13:56 user nova-compute[72803]: INFO nova.compute.manager [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 15 07:13:56 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:13:56 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] Acquiring lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] No waiting events found dispatching network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:13:57 user nova-compute[72803]: WARNING nova.compute.manager [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received unexpected event network-vif-plugged-26906fc5-11d2-4df0-9f43-0a6df7e8de04 for instance with vm_state active and task_state deleting.
Aug 15 07:13:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-changed-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Refreshing instance network info cache due to event network-changed-b7fa2fa2-1703-498b-b254-99602006af78. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] Acquiring lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] Acquired lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Refreshing network info cache for port b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:13:57 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:57 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Took 1.35 seconds to deallocate network for instance.
Aug 15 07:13:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updated VIF entry in instance network info cache for port b7fa2fa2-1703-498b-b254-99602006af78. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:13:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updating instance_info_cache with network_info: [{"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:13:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-891b3534-f4a6-4980-8140-2ea18df5ec95 req-b0d957c5-2007-4053-abd7-db93b7272506 service nova] Releasing lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:13:58 user nova-compute[72803]: INFO nova.compute.manager [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Took 0.96 seconds to detach 1 volumes for instance.
Aug 15 07:13:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Deleting volume: 739d0d35-77ef-4473-93c4-a7f1fe0171dc {{(pid=72803) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 07:13:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'flavor' on Instance uuid 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:13:59 user nova-compute[72803]: INFO nova.compute.manager [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Attaching volume 77862b94-1222-487d-a1fd-16bc29fff49a to /dev/vdb
Aug 15 07:13:59 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG os_brick.utils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c2228-a1ff-42bc-8c30-23025a53ce43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:59 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Deleted allocations for instance 36431f5c-df19-4836-ae18-8e9f7ae8d066
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ac92d-c856-4b85-9a1b-fe865d12fb96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfac2a7-5efc-45d8-a550-4d23ea6c2122]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[56797610-1ffe-4674-a694-f0f0c5f34b5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:13:59 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88966bf-9a4a-4c51-b38d-b9c7e53302cf]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-15dec100-ad2b-43d5-9546-57501089d1e9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "36431f5c-df19-4836-ae18-8e9f7ae8d066" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.059s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG os_brick.utils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updating existing volume attachment record: 6aaa3503-a4c2-40c6-a3f9-dce7c8289629 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:13:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-16fad41f-afe4-48d1-a092-4c6f0c02d092 req-37d23fdf-b83f-45c0-8007-0d7c48654b2d service nova] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Received event network-vif-deleted-26906fc5-11d2-4df0-9f43-0a6df7e8de04 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:14:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYjBCDmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:14:07 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:14:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:14:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:14:07 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:14:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:14:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:14:07 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:14:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:07 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9184aa44-45f9-444d-ae5d-eb180bf3d4c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:14:07 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae48a005-6fa6-4cf4-8ecb-367e9e83d908]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a] added
Aug 15 07:14:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[748b6141-af39-4a00-b0c1-00971f1d3d6b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbb5d0f-68bb-445d-aea4-ac531cf672cd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYjBCDmy {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYjBCDmy" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0234072-00f1-4058-bf8d-5d4e19584151]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYjBCDmy'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdcd998-8bbb-4e58-8bee-9b8c814f149c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ba56d9-7fdc-48f4-bd9e-01050b8a65e9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:14:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:14:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c3e410-3d7c-468f-b48f-05c953daf565]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a, portal: 172.16.0.220,3260]
Aug 15 07:14:08 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a, portal: 172.16.0.220,3260] successful.
Aug 15 07:14:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b32e8d-7c8d-4183-9ad7-6a379ad3fe43]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8cd5b3-bbd9-4993-b909-3f2ee6876175]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:14:08 user nova-compute[72803]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)
Aug 15 07:14:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:14:08 user nova-compute[72803]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)
Aug 15 07:14:08 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b29964-95fb-4be0-ae0f-d8c25c359312]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:14:08 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYjBCDmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26265353434633465', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265353434633465', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'flavor' on Instance uuid 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:14:09 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:14:09 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:14:09 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:14:09 user nova-compute[72803]:   <serial>77862b94-1222-487d-a1fd-16bc29fff49a</serial>
Aug 15 07:14:09 user nova-compute[72803]: </disk>
Aug 15 07:14:09 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No VIF found with MAC fa:16:3e:f5:30:60, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2fc52bc5-e139-4820-b99e-46dab7821d28 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.699s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:09 user nova-compute[72803]: INFO nova.compute.manager [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Terminating instance
Aug 15 07:14:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-9a8aedd3-acab-44d2-bc82-d5169f2b6d28 req-61bf3f6d-7ffe-4205-bf15-298887a16e2e service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9a8aedd3-acab-44d2-bc82-d5169f2b6d28 req-61bf3f6d-7ffe-4205-bf15-298887a16e2e service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9a8aedd3-acab-44d2-bc82-d5169f2b6d28 req-61bf3f6d-7ffe-4205-bf15-298887a16e2e service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9a8aedd3-acab-44d2-bc82-d5169f2b6d28 req-61bf3f6d-7ffe-4205-bf15-298887a16e2e service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-9a8aedd3-acab-44d2-bc82-d5169f2b6d28 req-61bf3f6d-7ffe-4205-bf15-298887a16e2e service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-9a8aedd3-acab-44d2-bc82-d5169f2b6d28 req-61bf3f6d-7ffe-4205-bf15-298887a16e2e service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-unplugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Instance destroyed successfully.
Aug 15 07:14:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'resources' on Instance uuid a4a01678-2255-4fb5-a497-1ceaab81422a {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:58:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1334484337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1334484337',id=14,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:00:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-qxngkyu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:02:11Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=a4a01678-2255-4fb5-a497-1ceaab81422a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "address": "fa:16:3e:de:30:72", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a8e9364-b7", "ovs_interfaceid": "8a8e9364-b7d1-4faf-9133-bd7c07abe0fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:30:72,bridge_name='br-int',has_traffic_filtering=True,id=8a8e9364-b7d1-4faf-9133-bd7c07abe0fa,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8e9364-b7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_vif [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:30:72,bridge_name='br-int',has_traffic_filtering=True,id=8a8e9364-b7d1-4faf-9133-bd7c07abe0fa,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8e9364-b7') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a8e9364-b7, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:14:10 user nova-compute[72803]: INFO os_vif [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:30:72,bridge_name='br-int',has_traffic_filtering=True,id=8a8e9364-b7d1-4faf-9133-bd7c07abe0fa,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a8e9364-b7')
Aug 15 07:14:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdFWucmI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:14:10 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b8a98e-300e-417e-ab7c-dc01db2b0e13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9472e088-f74d-4985-bf91-df34bca146ee]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:14:10 user nova-compute[72803]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)
Aug 15 07:14:10 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 (non-flash)
Aug 15 07:14:10 user nova-compute[72803]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)
Aug 15 07:14:10 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05f3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9'): ({'sdi'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Removing single pathed devices sdi {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a83cf8-a825-4e72-9b96-3c6249d09edb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c502b58-03d3-4c57-8082-de22407dd7b8]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Flushing IO for device /dev/sdi {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b8c9c-4090-444b-b5ce-b4210adcc870]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[de08f699-4c5d-4944-ad9d-d4a7eb7648a0]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] SCSI volumes sdi have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac62705-06b1-4c4f-bca5-39e8f676f5d4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7d8620-bf38-482c-bb3e-265b7e29d810]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9, portal: 172.16.0.220,3260]
Aug 15 07:14:10 user nova-compute[72803]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9, portal: 172.16.0.220,3260] successful.
Aug 15 07:14:10 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d2906-a088-45d0-928d-baa14cee31b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd415f1-5edb-4ea2-b83e-88b6fe1bfc6e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] <== disconnect_volume: return (290ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:14:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Deleting instance files /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a_del
Aug 15 07:14:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Deletion of /opt/stack/data/nova/instances/a4a01678-2255-4fb5-a497-1ceaab81422a_del complete
Aug 15 07:14:11 user nova-compute[72803]: INFO nova.compute.manager [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 15 07:14:11 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083636.1201108, 36431f5c-df19-4836-ae18-8e9f7ae8d066 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:14:11 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] VM Stopped (Lifecycle Event)
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-146ed839-5aad-4cf7-8859-e78bd12a5f4b None None] [instance: 36431f5c-df19-4836-ae18-8e9f7ae8d066] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:14:11 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Took 0.44 seconds to deallocate network for instance.
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-f3877587-2679-4f46-a12f-c61a3dab96d3 req-bae3b3f1-eab9-41fc-9b56-544178a106c9 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-deleted-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:11 user nova-compute[72803]: INFO nova.compute.manager [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Detaching volume 77862b94-1222-487d-a1fd-16bc29fff49a
Aug 15 07:14:11 user nova-compute[72803]: INFO nova.virt.block_device [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Attempting to driver detach volume 77862b94-1222-487d-a1fd-16bc29fff49a from mountpoint /dev/vdb
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Attempting to detach device vdb from instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:14:11 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:14:11 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:14:11 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:14:11 user nova-compute[72803]:   <serial>77862b94-1222-487d-a1fd-16bc29fff49a</serial>
Aug 15 07:14:11 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:14:11 user nova-compute[72803]: </disk>
Aug 15 07:14:11 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:14:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Successfully detached device vdb from instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 from the persistent domain config.
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:14:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:14:11 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:14:11 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:14:11 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:14:11 user nova-compute[72803]:   <serial>77862b94-1222-487d-a1fd-16bc29fff49a</serial>
Aug 15 07:14:11 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:14:11 user nova-compute[72803]: </disk>
Aug 15 07:14:11 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083652.2601612, 8d0be6c9-8e93-4a50-bf2b-d287e619b303 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:14:12 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Successfully detached device vdb from instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 from the live domain config.
Aug 15 07:14:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYjBCDmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:14:12 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: INFO nova.compute.manager [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Took 0.75 seconds to detach 1 volumes for instance.
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dda6f29-2340-4744-b74d-bdf3daa2b251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d05564-22b0-4747-bb49-26bf900e1b56]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)
Aug 15 07:14:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a (non-flash)
Aug 15 07:14:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05ab7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3299abd8-dee6-4a02-a48f-d7569cdc4181]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-c20eeb16-0b1d-4ab5-a183-0832e276f75f req-482a55cb-9c07-496c-a716-479f8358da20 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c20eeb16-0b1d-4ab5-a183-0832e276f75f req-482a55cb-9c07-496c-a716-479f8358da20 service nova] Acquiring lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c20eeb16-0b1d-4ab5-a183-0832e276f75f req-482a55cb-9c07-496c-a716-479f8358da20 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c20eeb16-0b1d-4ab5-a183-0832e276f75f req-482a55cb-9c07-496c-a716-479f8358da20 service nova] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-c20eeb16-0b1d-4ab5-a183-0832e276f75f req-482a55cb-9c07-496c-a716-479f8358da20 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] No waiting events found dispatching network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:12 user nova-compute[72803]: WARNING nova.compute.manager [req-c20eeb16-0b1d-4ab5-a183-0832e276f75f req-482a55cb-9c07-496c-a716-479f8358da20 service nova] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Received unexpected event network-vif-plugged-8a8e9364-b7d1-4faf-9133-bd7c07abe0fa for instance with vm_state deleted and task_state None.
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d7ee86-7a32-4298-9ffd-e037ef63da8e]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ffe582-cc7d-4079-98a8-9c026bfacd5d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de498cb-1a77-402e-b936-69f4ea15aa42]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d355748-d528-445c-976f-b90b6be2c443]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8c63a3-63eb-4f94-95de-c0d07a0e6f38]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a, portal: 172.16.0.220,3260]
Aug 15 07:14:12 user nova-compute[72803]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a, portal: 172.16.0.220,3260] successful.
Aug 15 07:14:12 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77862b94-1222-487d-a1fd-16bc29fff49a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eaf8cc-b2cd-456d-9440-1ba1e9303c71]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] <== disconnect_volume: return (295ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:12 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Deleted allocations for instance a4a01678-2255-4fb5-a497-1ceaab81422a
Aug 15 07:14:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ba19af4-59df-4913-98a4-ba0bfd324eff tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "a4a01678-2255-4fb5-a497-1ceaab81422a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.774s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:13 user nova-compute[72803]: DEBUG nova.objects.instance [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'flavor' on Instance uuid 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df2feaed-3ec8-465e-ae8c-b0e8eef156ad tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "57078f15-a8c6-4603-b158-3339af0cb88c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:14:18 user nova-compute[72803]: INFO nova.compute.claims [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Claim successful on node user
Aug 15 07:14:18 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:14:18 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:14:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:14:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.policy [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b510bc4a21940ae904886cfeaa8e29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c703e687f99045339795915d5dff031e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:14:19 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Creating image(s)
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "/opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "/opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "/opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk 1073741824" returned: 0 in 0.053s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Successfully created port: bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Cannot resize image /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lazy-loading 'migration_context' on Instance uuid 57078f15-a8c6-4603-b158-3339af0cb88c {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Ensure instance console log exists: /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Successfully updated port: bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "refresh_cache-57078f15-a8c6-4603-b158-3339af0cb88c" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquired lock "refresh_cache-57078f15-a8c6-4603-b158-3339af0cb88c" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-559cc45d-8e1d-44a8-9cdc-486fa9337cc1 req-3f28c34d-448b-4291-b44f-5482ac7bb56b service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-changed-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-559cc45d-8e1d-44a8-9cdc-486fa9337cc1 req-3f28c34d-448b-4291-b44f-5482ac7bb56b service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Refreshing instance network info cache due to event network-changed-bedd7958-9e70-4158-b334-ebd6cf98d9a3. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-559cc45d-8e1d-44a8-9cdc-486fa9337cc1 req-3f28c34d-448b-4291-b44f-5482ac7bb56b service nova] Acquiring lock "refresh_cache-57078f15-a8c6-4603-b158-3339af0cb88c" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Updating instance_info_cache with network_info: [{"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Releasing lock "refresh_cache-57078f15-a8c6-4603-b158-3339af0cb88c" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Instance network_info: |[{"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-559cc45d-8e1d-44a8-9cdc-486fa9337cc1 req-3f28c34d-448b-4291-b44f-5482ac7bb56b service nova] Acquired lock "refresh_cache-57078f15-a8c6-4603-b158-3339af0cb88c" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-559cc45d-8e1d-44a8-9cdc-486fa9337cc1 req-3f28c34d-448b-4291-b44f-5482ac7bb56b service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Refreshing network info cache for port bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Start _get_guest_xml network_info=[{"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:14:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:14:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-166883018',display_name='tempest-VolumesActionsTest-instance-166883018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-166883018',id=37,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c703e687f99045339795915d5dff031e',ramdisk_id='',reservation_id='r-5aaihue2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1941402153',owner_user_name='tempest-VolumesActionsTest-1941402153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:14:19Z,user_data=None,user_id='9b510bc4a21940ae904886cfeaa8e29f',uuid=57078f15-a8c6-4603-b158-3339af0cb88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converting VIF {"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e6:6d,bridge_name='br-int',has_traffic_filtering=True,id=bedd7958-9e70-4158-b334-ebd6cf98d9a3,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbedd7958-9e') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lazy-loading 'pci_devices' on Instance uuid 57078f15-a8c6-4603-b158-3339af0cb88c {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:14:20 user nova-compute[72803]:   <uuid>57078f15-a8c6-4603-b158-3339af0cb88c</uuid>
Aug 15 07:14:20 user nova-compute[72803]:   <name>instance-00000025</name>
Aug 15 07:14:20 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:14:20 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:14:20 user nova-compute[72803]:   <metadata>
Aug 15 07:14:20 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:14:20 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:14:20 user nova-compute[72803]:       <nova:name>tempest-VolumesActionsTest-instance-166883018</nova:name>
Aug 15 07:14:20 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:14:20</nova:creationTime>
Aug 15 07:14:20 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:14:20 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:14:20 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:14:20 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:14:20 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:14:20 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:14:20 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:14:20 user nova-compute[72803]:       <nova:owner>
Aug 15 07:14:20 user nova-compute[72803]:         <nova:user uuid="9b510bc4a21940ae904886cfeaa8e29f">tempest-VolumesActionsTest-1941402153-project-member</nova:user>
Aug 15 07:14:20 user nova-compute[72803]:         <nova:project uuid="c703e687f99045339795915d5dff031e">tempest-VolumesActionsTest-1941402153</nova:project>
Aug 15 07:14:20 user nova-compute[72803]:       </nova:owner>
Aug 15 07:14:20 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:14:20 user nova-compute[72803]:       <nova:ports>
Aug 15 07:14:20 user nova-compute[72803]:         <nova:port uuid="bedd7958-9e70-4158-b334-ebd6cf98d9a3">
Aug 15 07:14:20 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 07:14:20 user nova-compute[72803]:         </nova:port>
Aug 15 07:14:20 user nova-compute[72803]:       </nova:ports>
Aug 15 07:14:20 user nova-compute[72803]:     </nova:instance>
Aug 15 07:14:20 user nova-compute[72803]:   </metadata>
Aug 15 07:14:20 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:14:20 user nova-compute[72803]:     <system>
Aug 15 07:14:20 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:14:20 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:14:20 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:14:20 user nova-compute[72803]:       <entry name="serial">57078f15-a8c6-4603-b158-3339af0cb88c</entry>
Aug 15 07:14:20 user nova-compute[72803]:       <entry name="uuid">57078f15-a8c6-4603-b158-3339af0cb88c</entry>
Aug 15 07:14:20 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:14:20 user nova-compute[72803]:     </system>
Aug 15 07:14:20 user nova-compute[72803]:   </sysinfo>
Aug 15 07:14:20 user nova-compute[72803]:   <os>
Aug 15 07:14:20 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:14:20 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:14:20 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:14:20 user nova-compute[72803]:   </os>
Aug 15 07:14:20 user nova-compute[72803]:   <features>
Aug 15 07:14:20 user nova-compute[72803]:     <acpi/>
Aug 15 07:14:20 user nova-compute[72803]:     <apic/>
Aug 15 07:14:20 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:14:20 user nova-compute[72803]:   </features>
Aug 15 07:14:20 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:14:20 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:14:20 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:14:20 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:14:20 user nova-compute[72803]:   </clock>
Aug 15 07:14:20 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:14:20 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:14:20 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:14:20 user nova-compute[72803]:   </cpu>
Aug 15 07:14:20 user nova-compute[72803]:   <devices>
Aug 15 07:14:20 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:14:20 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:14:20 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk"/>
Aug 15 07:14:20 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:14:20 user nova-compute[72803]:     </disk>
Aug 15 07:14:20 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:14:20 user nova-compute[72803]:       <mac address="fa:16:3e:77:e6:6d"/>
Aug 15 07:14:20 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:14:20 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:14:20 user nova-compute[72803]:       <target dev="tapbedd7958-9e"/>
Aug 15 07:14:20 user nova-compute[72803]:     </interface>
Aug 15 07:14:20 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:14:20 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/console.log" append="off"/>
Aug 15 07:14:20 user nova-compute[72803]:     </serial>
Aug 15 07:14:20 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:14:20 user nova-compute[72803]:     <video>
Aug 15 07:14:20 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:14:20 user nova-compute[72803]:     </video>
Aug 15 07:14:20 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:14:20 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:14:20 user nova-compute[72803]:     </rng>
Aug 15 07:14:20 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:14:20 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:14:20 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:14:20 user nova-compute[72803]:     </memballoon>
Aug 15 07:14:20 user nova-compute[72803]:   </devices>
Aug 15 07:14:20 user nova-compute[72803]: </domain>
Aug 15 07:14:20 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-166883018',display_name='tempest-VolumesActionsTest-instance-166883018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-166883018',id=37,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c703e687f99045339795915d5dff031e',ramdisk_id='',reservation_id='r-5aaihue2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1941402153',owner_user_name='tempest-VolumesActionsTest-1941402153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:14:19Z,user_data=None,user_id='9b510bc4a21940ae904886cfeaa8e29f',uuid=57078f15-a8c6-4603-b158-3339af0cb88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converting VIF {"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e6:6d,bridge_name='br-int',has_traffic_filtering=True,id=bedd7958-9e70-4158-b334-ebd6cf98d9a3,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbedd7958-9e') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG os_vif [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e6:6d,bridge_name='br-int',has_traffic_filtering=True,id=bedd7958-9e70-4158-b334-ebd6cf98d9a3,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbedd7958-9e') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbedd7958-9e, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbedd7958-9e, col_values=(('external_ids', {'iface-id': 'bedd7958-9e70-4158-b334-ebd6cf98d9a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:e6:6d', 'vm-uuid': '57078f15-a8c6-4603-b158-3339af0cb88c'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:20 user nova-compute[72803]: INFO os_vif [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e6:6d,bridge_name='br-int',has_traffic_filtering=True,id=bedd7958-9e70-4158-b334-ebd6cf98d9a3,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbedd7958-9e')
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:14:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] No VIF found with MAC fa:16:3e:77:e6:6d, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:14:21 user nova-compute[72803]: DEBUG nova.network.neutron [req-559cc45d-8e1d-44a8-9cdc-486fa9337cc1 req-3f28c34d-448b-4291-b44f-5482ac7bb56b service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Updated VIF entry in instance network info cache for port bedd7958-9e70-4158-b334-ebd6cf98d9a3. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:14:21 user nova-compute[72803]: DEBUG nova.network.neutron [req-559cc45d-8e1d-44a8-9cdc-486fa9337cc1 req-3f28c34d-448b-4291-b44f-5482ac7bb56b service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Updating instance_info_cache with network_info: [{"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:14:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-559cc45d-8e1d-44a8-9cdc-486fa9337cc1 req-3f28c34d-448b-4291-b44f-5482ac7bb56b service nova] Releasing lock "refresh_cache-57078f15-a8c6-4603-b158-3339af0cb88c" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-c8ce2da4-725d-4a3b-a87b-7ff0e9c184d8 req-bf8c29b7-b128-4aeb-b86c-6ea27ead6791 service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8ce2da4-725d-4a3b-a87b-7ff0e9c184d8 req-bf8c29b7-b128-4aeb-b86c-6ea27ead6791 service nova] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8ce2da4-725d-4a3b-a87b-7ff0e9c184d8 req-bf8c29b7-b128-4aeb-b86c-6ea27ead6791 service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c8ce2da4-725d-4a3b-a87b-7ff0e9c184d8 req-bf8c29b7-b128-4aeb-b86c-6ea27ead6791 service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG nova.compute.manager [req-c8ce2da4-725d-4a3b-a87b-7ff0e9c184d8 req-bf8c29b7-b128-4aeb-b86c-6ea27ead6791 service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] No waiting events found dispatching network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:22 user nova-compute[72803]: WARNING nova.compute.manager [req-c8ce2da4-725d-4a3b-a87b-7ff0e9c184d8 req-bf8c29b7-b128-4aeb-b86c-6ea27ead6791 service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received unexpected event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 for instance with vm_state building and task_state spawning.
Aug 15 07:14:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083664.5769794, 57078f15-a8c6-4603-b158-3339af0cb88c => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:14:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] VM Resumed (Lifecycle Event)
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:14:24 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Instance spawned successfully.
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:14:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083664.5781827, 57078f15-a8c6-4603-b158-3339af0cb88c => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:14:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] VM Started (Lifecycle Event)
Aug 15 07:14:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-15de4733-3018-4254-a45d-e3be61c371d0 req-744385ee-de85-437e-950e-13720a7f4687 service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-15de4733-3018-4254-a45d-e3be61c371d0 req-744385ee-de85-437e-950e-13720a7f4687 service nova] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-15de4733-3018-4254-a45d-e3be61c371d0 req-744385ee-de85-437e-950e-13720a7f4687 service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-15de4733-3018-4254-a45d-e3be61c371d0 req-744385ee-de85-437e-950e-13720a7f4687 service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-15de4733-3018-4254-a45d-e3be61c371d0 req-744385ee-de85-437e-950e-13720a7f4687 service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] No waiting events found dispatching network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:24 user nova-compute[72803]: WARNING nova.compute.manager [req-15de4733-3018-4254-a45d-e3be61c371d0 req-744385ee-de85-437e-950e-13720a7f4687 service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received unexpected event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 for instance with vm_state building and task_state spawning.
Aug 15 07:14:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:14:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Took 5.61 seconds to spawn the instance on the hypervisor.
Aug 15 07:14:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:14:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Took 6.30 seconds to build instance.
Aug 15 07:14:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e43af07-b58c-48d8-8189-710ccba91848 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "57078f15-a8c6-4603-b158-3339af0cb88c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.384s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:25 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083650.680924, a4a01678-2255-4fb5-a497-1ceaab81422a => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:14:25 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] VM Stopped (Lifecycle Event)
Aug 15 07:14:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f5683ffd-81d8-4de9-8015-4bacdb4dda6b None None] [instance: a4a01678-2255-4fb5-a497-1ceaab81422a] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:14:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:14:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:14:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:14:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:14:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:38 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:41 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:14:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:14:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:14:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:14:46 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [{"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-0777bcb5-966e-424a-8732-e53c6352183e" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:48 user nova-compute[72803]: INFO nova.compute.manager [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Rescuing
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquired lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG nova.network.neutron [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG nova.network.neutron [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updating instance_info_cache with network_info: [{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:14:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Releasing lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-573f3655-64ec-4dd2-8817-da99a2671477 req-beead0ca-e5da-4940-b538-6d6b1a4c7ecf service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-unplugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-573f3655-64ec-4dd2-8817-da99a2671477 req-beead0ca-e5da-4940-b538-6d6b1a4c7ecf service nova] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-573f3655-64ec-4dd2-8817-da99a2671477 req-beead0ca-e5da-4940-b538-6d6b1a4c7ecf service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-573f3655-64ec-4dd2-8817-da99a2671477 req-beead0ca-e5da-4940-b538-6d6b1a4c7ecf service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-573f3655-64ec-4dd2-8817-da99a2671477 req-beead0ca-e5da-4940-b538-6d6b1a4c7ecf service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] No waiting events found dispatching network-vif-unplugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:49 user nova-compute[72803]: WARNING nova.compute.manager [req-573f3655-64ec-4dd2-8817-da99a2671477 req-beead0ca-e5da-4940-b538-6d6b1a4c7ecf service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received unexpected event network-vif-unplugged-7286db1d-0212-4863-acff-f1206f583449 for instance with vm_state active and task_state rescuing.
Aug 15 07:14:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Instance destroyed successfully.
Aug 15 07:14:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Attempting rescue
Aug 15 07:14:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72803) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Instance directory exists: not creating {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 07:14:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Creating image(s)
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG nova.objects.instance [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'trusted_certs' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue" returned: 0 in 0.066s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'migration_context' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Start _get_guest_xml network_info=[{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:07:d6:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'resources' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'numa_topology' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:50 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:14:50 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'vcpu_model' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:50 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:14:50 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8013MB free_disk=25.293418884277344GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-553899271',display_name='tempest-ServerRescueNegativeTestJSON-server-553899271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-553899271',id=36,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:13:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-nyo082ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:13:05Z,user_data=None,user_id='0cf4a499a9d54262bd8959b87918717c',uuid=511e9555-52a0-4f2c-b4ff-0f68ba2c32be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:07:d6:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:07:d6:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:d6:0a,bridge_name='br-int',has_traffic_filtering=True,id=7286db1d-0212-4863-acff-f1206f583449,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7286db1d-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'pci_devices' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:14:50 user nova-compute[72803]:   <uuid>511e9555-52a0-4f2c-b4ff-0f68ba2c32be</uuid>
Aug 15 07:14:50 user nova-compute[72803]:   <name>instance-00000024</name>
Aug 15 07:14:50 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:14:50 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:14:50 user nova-compute[72803]:   <metadata>
Aug 15 07:14:50 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:14:50 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:14:50 user nova-compute[72803]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-553899271</nova:name>
Aug 15 07:14:50 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:14:50</nova:creationTime>
Aug 15 07:14:50 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:14:50 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:14:50 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:14:50 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:14:50 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:14:50 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:14:50 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:14:50 user nova-compute[72803]:       <nova:owner>
Aug 15 07:14:50 user nova-compute[72803]:         <nova:user uuid="0cf4a499a9d54262bd8959b87918717c">tempest-ServerRescueNegativeTestJSON-1974019782-project-member</nova:user>
Aug 15 07:14:50 user nova-compute[72803]:         <nova:project uuid="eaa8ac0862d14e7792d6c03f46c170ba">tempest-ServerRescueNegativeTestJSON-1974019782</nova:project>
Aug 15 07:14:50 user nova-compute[72803]:       </nova:owner>
Aug 15 07:14:50 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:14:50 user nova-compute[72803]:       <nova:ports>
Aug 15 07:14:50 user nova-compute[72803]:         <nova:port uuid="7286db1d-0212-4863-acff-f1206f583449">
Aug 15 07:14:50 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:14:50 user nova-compute[72803]:         </nova:port>
Aug 15 07:14:50 user nova-compute[72803]:       </nova:ports>
Aug 15 07:14:50 user nova-compute[72803]:     </nova:instance>
Aug 15 07:14:50 user nova-compute[72803]:   </metadata>
Aug 15 07:14:50 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:14:50 user nova-compute[72803]:     <system>
Aug 15 07:14:50 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:14:50 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:14:50 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:14:50 user nova-compute[72803]:       <entry name="serial">511e9555-52a0-4f2c-b4ff-0f68ba2c32be</entry>
Aug 15 07:14:50 user nova-compute[72803]:       <entry name="uuid">511e9555-52a0-4f2c-b4ff-0f68ba2c32be</entry>
Aug 15 07:14:50 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:14:50 user nova-compute[72803]:     </system>
Aug 15 07:14:50 user nova-compute[72803]:   </sysinfo>
Aug 15 07:14:50 user nova-compute[72803]:   <os>
Aug 15 07:14:50 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:14:50 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:14:50 user nova-compute[72803]:   </os>
Aug 15 07:14:50 user nova-compute[72803]:   <features>
Aug 15 07:14:50 user nova-compute[72803]:     <acpi/>
Aug 15 07:14:50 user nova-compute[72803]:     <apic/>
Aug 15 07:14:50 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:14:50 user nova-compute[72803]:   </features>
Aug 15 07:14:50 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:14:50 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:14:50 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:14:50 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:14:50 user nova-compute[72803]:   </clock>
Aug 15 07:14:50 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:14:50 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:14:50 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:14:50 user nova-compute[72803]:   </cpu>
Aug 15 07:14:50 user nova-compute[72803]:   <devices>
Aug 15 07:14:50 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:14:50 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:14:50 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue"/>
Aug 15 07:14:50 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:14:50 user nova-compute[72803]:     </disk>
Aug 15 07:14:50 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:14:50 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:14:50 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk"/>
Aug 15 07:14:50 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:14:50 user nova-compute[72803]:     </disk>
Aug 15 07:14:50 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:14:50 user nova-compute[72803]:       <mac address="fa:16:3e:07:d6:0a"/>
Aug 15 07:14:50 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:14:50 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:14:50 user nova-compute[72803]:       <target dev="tap7286db1d-02"/>
Aug 15 07:14:50 user nova-compute[72803]:     </interface>
Aug 15 07:14:50 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:14:50 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/console.log" append="off"/>
Aug 15 07:14:50 user nova-compute[72803]:     </serial>
Aug 15 07:14:50 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:14:50 user nova-compute[72803]:     <video>
Aug 15 07:14:50 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:14:50 user nova-compute[72803]:     </video>
Aug 15 07:14:50 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:14:50 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:14:50 user nova-compute[72803]:     </rng>
Aug 15 07:14:50 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:14:50 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:14:50 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:14:50 user nova-compute[72803]:     </memballoon>
Aug 15 07:14:50 user nova-compute[72803]:   </devices>
Aug 15 07:14:50 user nova-compute[72803]: </domain>
Aug 15 07:14:50 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:14:50 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Instance destroyed successfully.
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 0777bcb5-966e-424a-8732-e53c6352183e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 57078f15-a8c6-4603-b158-3339af0cb88c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No VIF found with MAC fa:16:3e:07:d6:0a, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:14:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-59fa54cd-bdc8-4df2-a44d-0333e5f05762 req-3c47cf3b-d465-4b64-9ad2-49bb97e1c585 service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-59fa54cd-bdc8-4df2-a44d-0333e5f05762 req-3c47cf3b-d465-4b64-9ad2-49bb97e1c585 service nova] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-59fa54cd-bdc8-4df2-a44d-0333e5f05762 req-3c47cf3b-d465-4b64-9ad2-49bb97e1c585 service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-59fa54cd-bdc8-4df2-a44d-0333e5f05762 req-3c47cf3b-d465-4b64-9ad2-49bb97e1c585 service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:51 user nova-compute[72803]: DEBUG nova.compute.manager [req-59fa54cd-bdc8-4df2-a44d-0333e5f05762 req-3c47cf3b-d465-4b64-9ad2-49bb97e1c585 service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] No waiting events found dispatching network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:51 user nova-compute[72803]: WARNING nova.compute.manager [req-59fa54cd-bdc8-4df2-a44d-0333e5f05762 req-3c47cf3b-d465-4b64-9ad2-49bb97e1c585 service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received unexpected event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 for instance with vm_state active and task_state rescuing.
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "0777bcb5-966e-424a-8732-e53c6352183e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:52 user nova-compute[72803]: INFO nova.compute.manager [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Terminating instance
Aug 15 07:14:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-98c58ecd-3264-428f-b092-4ee56db4f5ca req-57071c70-6c47-4c38-b77f-4cda40415f51 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-vif-unplugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-98c58ecd-3264-428f-b092-4ee56db4f5ca req-57071c70-6c47-4c38-b77f-4cda40415f51 service nova] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-98c58ecd-3264-428f-b092-4ee56db4f5ca req-57071c70-6c47-4c38-b77f-4cda40415f51 service nova] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-98c58ecd-3264-428f-b092-4ee56db4f5ca req-57071c70-6c47-4c38-b77f-4cda40415f51 service nova] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-98c58ecd-3264-428f-b092-4ee56db4f5ca req-57071c70-6c47-4c38-b77f-4cda40415f51 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] No waiting events found dispatching network-vif-unplugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG nova.compute.manager [req-98c58ecd-3264-428f-b092-4ee56db4f5ca req-57071c70-6c47-4c38-b77f-4cda40415f51 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-vif-unplugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:14:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:14:53 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Instance destroyed successfully.
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.objects.instance [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lazy-loading 'resources' on Instance uuid 0777bcb5-966e-424a-8732-e53c6352183e {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664143132',display_name='tempest-ServerActionsTestOtherA-server-1664143132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664143132',id=4,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5dUjTaBLedZ6kEycL6SilyJT7Wz5droa6CycQ511Vvgp1PU/CsMnh9vNKZzAswF4hKWhRDsjXal+S9iyPG/npBgLeSp+OOeeC6xDdaLCWkr2Zt4DsVth2QHs4HiVUFIw==',key_name='tempest-keypair-1037271297',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecaf763674bc4aaca9e52eda0cf41f44',ramdisk_id='',reservation_id='r-0rjopwim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-931999183',owner_user_name='tempest-ServerActionsTestOtherA-931999183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:55:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1e4fd69d1a64b8d80b0d1a45d62190f',uuid=0777bcb5-966e-424a-8732-e53c6352183e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converting VIF {"id": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "address": "fa:16:3e:a2:4e:fb", "network": {"id": "5c121c05-3841-4cec-aba3-dd7e311cf760", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1992696060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecaf763674bc4aaca9e52eda0cf41f44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a1c323-0e", "ovs_interfaceid": "d6a1c323-0e6e-4be7-a45d-d26e3ac2d718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=d6a1c323-0e6e-4be7-a45d-d26e3ac2d718,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a1c323-0e') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG os_vif [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=d6a1c323-0e6e-4be7-a45d-d26e3ac2d718,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a1c323-0e') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6a1c323-0e, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:14:53 user nova-compute[72803]: INFO os_vif [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:4e:fb,bridge_name='br-int',has_traffic_filtering=True,id=d6a1c323-0e6e-4be7-a45d-d26e3ac2d718,network=Network(5c121c05-3841-4cec-aba3-dd7e311cf760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a1c323-0e')
Aug 15 07:14:53 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Deleting instance files /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e_del
Aug 15 07:14:53 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Deletion of /opt/stack/data/nova/instances/0777bcb5-966e-424a-8732-e53c6352183e_del complete
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] No waiting events found dispatching network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:53 user nova-compute[72803]: WARNING nova.compute.manager [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received unexpected event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 for instance with vm_state active and task_state rescuing.
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] No waiting events found dispatching network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:53 user nova-compute[72803]: WARNING nova.compute.manager [req-c2bff4ba-6db4-474b-b3e2-6f3711c4c117 req-0874cab7-bd1f-4765-91a0-f8ac49728fed service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received unexpected event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 for instance with vm_state active and task_state rescuing.
Aug 15 07:14:53 user nova-compute[72803]: INFO nova.compute.manager [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 07:14:53 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:14:53 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:14:54 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Took 0.55 seconds to deallocate network for instance.
Aug 15 07:14:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 511e9555-52a0-4f2c-b4ff-0f68ba2c32be due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083694.3320692, 511e9555-52a0-4f2c-b4ff-0f68ba2c32be => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:14:54 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] VM Resumed (Lifecycle Event)
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-18f25821-60ac-4c48-a405-ed0a63b80373 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:14:54 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083694.3334327, 511e9555-52a0-4f2c-b4ff-0f68ba2c32be => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:14:54 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] VM Started (Lifecycle Event)
Aug 15 07:14:54 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Deleted allocations for instance 0777bcb5-966e-424a-8732-e53c6352183e
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:14:54 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 07:14:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-26d1c034-6bba-4383-8147-6847312e98a9 tempest-ServerActionsTestOtherA-931999183 tempest-ServerActionsTestOtherA-931999183-project-member] Lock "0777bcb5-966e-424a-8732-e53c6352183e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.970s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-a72b8185-0ee4-4028-9338-6a24546a3f72 req-b61b680d-6174-4170-bc4e-280d2430ce45 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a72b8185-0ee4-4028-9338-6a24546a3f72 req-b61b680d-6174-4170-bc4e-280d2430ce45 service nova] Acquiring lock "0777bcb5-966e-424a-8732-e53c6352183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a72b8185-0ee4-4028-9338-6a24546a3f72 req-b61b680d-6174-4170-bc4e-280d2430ce45 service nova] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a72b8185-0ee4-4028-9338-6a24546a3f72 req-b61b680d-6174-4170-bc4e-280d2430ce45 service nova] Lock "0777bcb5-966e-424a-8732-e53c6352183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-a72b8185-0ee4-4028-9338-6a24546a3f72 req-b61b680d-6174-4170-bc4e-280d2430ce45 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] No waiting events found dispatching network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:14:54 user nova-compute[72803]: WARNING nova.compute.manager [req-a72b8185-0ee4-4028-9338-6a24546a3f72 req-b61b680d-6174-4170-bc4e-280d2430ce45 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received unexpected event network-vif-plugged-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 for instance with vm_state deleted and task_state None.
Aug 15 07:14:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-a72b8185-0ee4-4028-9338-6a24546a3f72 req-b61b680d-6174-4170-bc4e-280d2430ce45 service nova] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Received event network-vif-deleted-d6a1c323-0e6e-4be7-a45d-d26e3ac2d718 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:14:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:00 user nova-compute[72803]: INFO nova.compute.manager [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Terminating instance
Aug 15 07:15:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-9bb32091-b9c9-4795-9aff-cd0495537b75 req-22e6a15e-4b6c-42e4-a0b8-471895470a88 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received event network-vif-unplugged-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9bb32091-b9c9-4795-9aff-cd0495537b75 req-22e6a15e-4b6c-42e4-a0b8-471895470a88 service nova] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9bb32091-b9c9-4795-9aff-cd0495537b75 req-22e6a15e-4b6c-42e4-a0b8-471895470a88 service nova] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9bb32091-b9c9-4795-9aff-cd0495537b75 req-22e6a15e-4b6c-42e4-a0b8-471895470a88 service nova] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-9bb32091-b9c9-4795-9aff-cd0495537b75 req-22e6a15e-4b6c-42e4-a0b8-471895470a88 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] No waiting events found dispatching network-vif-unplugged-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-9bb32091-b9c9-4795-9aff-cd0495537b75 req-22e6a15e-4b6c-42e4-a0b8-471895470a88 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received event network-vif-unplugged-776d1973-187f-449d-befe-e6780ba387d7 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:01 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Instance destroyed successfully.
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lazy-loading 'resources' on Instance uuid 4074dae9-9d30-4b2a-b0c3-58e57088e4bd {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-121904816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-121904816',id=1,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:55:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07ede5bd5cb24059bc4a185badef865d',ramdisk_id='',reservation_id='r-flp1s0j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:57:19Z,user_data=None,user_id='bc7ee5090ba54d4b8acbd4c9f84835f3',uuid=4074dae9-9d30-4b2a-b0c3-58e57088e4bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converting VIF {"id": "776d1973-187f-449d-befe-e6780ba387d7", "address": "fa:16:3e:fb:04:84", "network": {"id": "7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1653708213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07ede5bd5cb24059bc4a185badef865d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776d1973-18", "ovs_interfaceid": "776d1973-187f-449d-befe-e6780ba387d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=776d1973-187f-449d-befe-e6780ba387d7,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap776d1973-18') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG os_vif [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=776d1973-187f-449d-befe-e6780ba387d7,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap776d1973-18') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap776d1973-18, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:15:01 user nova-compute[72803]: INFO os_vif [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:04:84,bridge_name='br-int',has_traffic_filtering=True,id=776d1973-187f-449d-befe-e6780ba387d7,network=Network(7452fdbc-8ffe-4ae6-9edc-b3994c21b8e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap776d1973-18')
Aug 15 07:15:01 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Deleting instance files /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd_del
Aug 15 07:15:01 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Deletion of /opt/stack/data/nova/instances/4074dae9-9d30-4b2a-b0c3-58e57088e4bd_del complete
Aug 15 07:15:01 user nova-compute[72803]: INFO nova.compute.manager [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 07:15:01 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-d04be943-7ec2-482b-9257-a2e3c2a19735 req-22d0daa2-0c7b-4cfa-812f-eebe42967bd5 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received event network-vif-deleted-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:15:01 user nova-compute[72803]: INFO nova.compute.manager [req-d04be943-7ec2-482b-9257-a2e3c2a19735 req-22d0daa2-0c7b-4cfa-812f-eebe42967bd5 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Neutron deleted interface 776d1973-187f-449d-befe-e6780ba387d7; detaching it from the instance and deleting it from the info cache
Aug 15 07:15:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-d04be943-7ec2-482b-9257-a2e3c2a19735 req-22d0daa2-0c7b-4cfa-812f-eebe42967bd5 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:15:02 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Took 0.48 seconds to deallocate network for instance.
Aug 15 07:15:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-d04be943-7ec2-482b-9257-a2e3c2a19735 req-22d0daa2-0c7b-4cfa-812f-eebe42967bd5 service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Detach interface failed, port_id=776d1973-187f-449d-befe-e6780ba387d7, reason: Instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:15:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:02 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:15:02 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:15:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:02 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Deleted allocations for instance 4074dae9-9d30-4b2a-b0c3-58e57088e4bd
Aug 15 07:15:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e83f9f64-937d-4bc6-808a-7b850432f538 tempest-ServerBootFromVolumeStableRescueTest-1860507335 tempest-ServerBootFromVolumeStableRescueTest-1860507335-project-member] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.636s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-f5d86451-5577-4006-af63-d601df94df9c req-86f5fa3a-5ebc-426f-b10d-41f3cc03180e service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received event network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:15:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f5d86451-5577-4006-af63-d601df94df9c req-86f5fa3a-5ebc-426f-b10d-41f3cc03180e service nova] Acquiring lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f5d86451-5577-4006-af63-d601df94df9c req-86f5fa3a-5ebc-426f-b10d-41f3cc03180e service nova] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f5d86451-5577-4006-af63-d601df94df9c req-86f5fa3a-5ebc-426f-b10d-41f3cc03180e service nova] Lock "4074dae9-9d30-4b2a-b0c3-58e57088e4bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-f5d86451-5577-4006-af63-d601df94df9c req-86f5fa3a-5ebc-426f-b10d-41f3cc03180e service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] No waiting events found dispatching network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:15:03 user nova-compute[72803]: WARNING nova.compute.manager [req-f5d86451-5577-4006-af63-d601df94df9c req-86f5fa3a-5ebc-426f-b10d-41f3cc03180e service nova] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Received unexpected event network-vif-plugged-776d1973-187f-449d-befe-e6780ba387d7 for instance with vm_state deleted and task_state None.
Aug 15 07:15:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:08 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083693.366209, 0777bcb5-966e-424a-8732-e53c6352183e => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:15:08 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] VM Stopped (Lifecycle Event)
Aug 15 07:15:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d2dc6bed-b8c9-4d4f-a519-ae6ebcb0d641 None None] [instance: 0777bcb5-966e-424a-8732-e53c6352183e] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:15:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:15:10 user nova-compute[72803]: INFO nova.compute.manager [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] instance snapshotting
Aug 15 07:15:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Beginning live snapshot process
Aug 15 07:15:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json -f qcow2 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json -f qcow2 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp119q0rf2/d0a8825ea62347d5a693de6d2c3f1d8d.delta 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp119q0rf2/d0a8825ea62347d5a693de6d2c3f1d8d.delta 1073741824" returned: 0 in 0.049s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 07:15:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 07:15:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 07:15:12 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 07:15:12 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:15:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp119q0rf2/d0a8825ea62347d5a693de6d2c3f1d8d.delta /opt/stack/data/nova/instances/snapshots/tmp119q0rf2/d0a8825ea62347d5a693de6d2c3f1d8d {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:13 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp119q0rf2/d0a8825ea62347d5a693de6d2c3f1d8d.delta /opt/stack/data/nova/instances/snapshots/tmp119q0rf2/d0a8825ea62347d5a693de6d2c3f1d8d" returned: 0 in 0.471s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Snapshot extracted, beginning image upload
Aug 15 07:15:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Snapshot image upload complete
Aug 15 07:15:15 user nova-compute[72803]: INFO nova.compute.manager [None req-a6d6d57d-2ffb-450c-86d1-0ac02400dfd5 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Took 5.30 seconds to snapshot the instance on the hypervisor.
Aug 15 07:15:16 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083701.4139845, 4074dae9-9d30-4b2a-b0c3-58e57088e4bd => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:15:16 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] VM Stopped (Lifecycle Event)
Aug 15 07:15:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e5ac36b-d8f6-4ac7-977a-05956417fc78 None None] [instance: 4074dae9-9d30-4b2a-b0c3-58e57088e4bd] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:15:16 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:15:18 user nova-compute[72803]: INFO nova.compute.claims [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Claim successful on node user
Aug 15 07:15:18 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:15:18 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:15:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:15:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:15:19 user nova-compute[72803]: DEBUG nova.policy [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ddf3dcceb1f41adbc0f679d1a1014b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb2074606144e48a856a092c7e32781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:15:19 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:15:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:15:19 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Creating image(s)
Aug 15 07:15:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "/opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "/opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "/opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "846c024ace159ddb702617ae5c0c14df8d0660d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "846c024ace159ddb702617ae5c0c14df8d0660d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Successfully created port: 11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9.part --force-share --output=json" returned: 0 in 0.217s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG nova.virt.images [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] 536f4974-b4c1-4128-b487-bdc42061f503 was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9.part /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9.part /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9.converted" returned: 0 in 0.377s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "846c024ace159ddb702617ae5c0c14df8d0660d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.912s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Successfully updated port: 11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquired lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-11c4ed7e-561a-43c5-86c6-658700fed6f5 req-b65fa91c-fd4d-4fee-9b67-e4cfd1a6b355 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-changed-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-11c4ed7e-561a-43c5-86c6-658700fed6f5 req-b65fa91c-fd4d-4fee-9b67-e4cfd1a6b355 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Refreshing instance network info cache due to event network-changed-11b0649b-f346-475d-9d6e-c89efcc4418d. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-11c4ed7e-561a-43c5-86c6-658700fed6f5 req-b65fa91c-fd4d-4fee-9b67-e4cfd1a6b355 service nova] Acquiring lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "846c024ace159ddb702617ae5c0c14df8d0660d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "846c024ace159ddb702617ae5c0c14df8d0660d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9 --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9,backing_fmt=raw /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updating instance_info_cache with network_info: [{"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9,backing_fmt=raw /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk 1073741824" returned: 0 in 0.055s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "846c024ace159ddb702617ae5c0c14df8d0660d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Releasing lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Instance network_info: |[{"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-11c4ed7e-561a-43c5-86c6-658700fed6f5 req-b65fa91c-fd4d-4fee-9b67-e4cfd1a6b355 service nova] Acquired lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.neutron [req-11c4ed7e-561a-43c5-86c6-658700fed6f5 req-b65fa91c-fd4d-4fee-9b67-e4cfd1a6b355 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Refreshing network info cache for port 11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'migration_context' on Instance uuid 489f8bb1-12d2-4ba7-892a-b0906114b572 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Ensure instance console log exists: /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Start _get_guest_xml network_info=[{"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='03ad7eac7a4b188e8216aab425af3f8d',container_format='bare',created_at=2023-08-15T07:15:10Z,direct_url=<?>,disk_format='qcow2',id=536f4974-b4c1-4128-b487-bdc42061f503,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1244203035',owner='adb2074606144e48a856a092c7e32781',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T07:15:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '536f4974-b4c1-4128-b487-bdc42061f503'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:15:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:15:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='03ad7eac7a4b188e8216aab425af3f8d',container_format='bare',created_at=2023-08-15T07:15:10Z,direct_url=<?>,disk_format='qcow2',id=536f4974-b4c1-4128-b487-bdc42061f503,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1244203035',owner='adb2074606144e48a856a092c7e32781',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T07:15:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2035112338',display_name='tempest-TestStampPattern-server-2035112338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2035112338',id=38,image_ref='536f4974-b4c1-4128-b487-bdc42061f503',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYEdS660yr6zgAKFBXVbvLxAfpYjVGFPDW51c3q4Ydsz8Eye3gBE8udzyAe91FO7kCB6FzhaCGWoXBMPYW0RCVxd9Mg8nCu2yJHA/4Si/grKlEE/CLjLGwDhuMUdNTz9w==',key_name='tempest-TestStampPattern-1230572878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb2074606144e48a856a092c7e32781',ramdisk_id='',reservation_id='r-jdjdwloo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8d0be6c9-8e93-4a50-bf2b-d287e619b303',image_min_disk='1',image_min_ram='0',image_owner_id='adb2074606144e48a856a092c7e32781',image_owner_project_name='tempest-TestStampPattern-1675165439',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1675165439-project-member',image_user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',network_allocated='True',owner_project_name='tempest-TestStampPattern-1675165439',owner_user_name='tempest-TestStampPattern-1675165439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:15:19Z,user_data=None,user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',uuid=489f8bb1-12d2-4ba7-892a-b0906114b572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converting VIF {"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=11b0649b-f346-475d-9d6e-c89efcc4418d,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b0649b-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'pci_devices' on Instance uuid 489f8bb1-12d2-4ba7-892a-b0906114b572 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:15:21 user nova-compute[72803]:   <uuid>489f8bb1-12d2-4ba7-892a-b0906114b572</uuid>
Aug 15 07:15:21 user nova-compute[72803]:   <name>instance-00000026</name>
Aug 15 07:15:21 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:15:21 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:15:21 user nova-compute[72803]:   <metadata>
Aug 15 07:15:21 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:15:21 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:15:21 user nova-compute[72803]:       <nova:name>tempest-TestStampPattern-server-2035112338</nova:name>
Aug 15 07:15:21 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:15:21</nova:creationTime>
Aug 15 07:15:21 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:15:21 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:15:21 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:15:21 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:15:21 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:15:21 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:15:21 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:15:21 user nova-compute[72803]:       <nova:owner>
Aug 15 07:15:21 user nova-compute[72803]:         <nova:user uuid="1ddf3dcceb1f41adbc0f679d1a1014b1">tempest-TestStampPattern-1675165439-project-member</nova:user>
Aug 15 07:15:21 user nova-compute[72803]:         <nova:project uuid="adb2074606144e48a856a092c7e32781">tempest-TestStampPattern-1675165439</nova:project>
Aug 15 07:15:21 user nova-compute[72803]:       </nova:owner>
Aug 15 07:15:21 user nova-compute[72803]:       <nova:root type="image" uuid="536f4974-b4c1-4128-b487-bdc42061f503"/>
Aug 15 07:15:21 user nova-compute[72803]:       <nova:ports>
Aug 15 07:15:21 user nova-compute[72803]:         <nova:port uuid="11b0649b-f346-475d-9d6e-c89efcc4418d">
Aug 15 07:15:21 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 07:15:21 user nova-compute[72803]:         </nova:port>
Aug 15 07:15:21 user nova-compute[72803]:       </nova:ports>
Aug 15 07:15:21 user nova-compute[72803]:     </nova:instance>
Aug 15 07:15:21 user nova-compute[72803]:   </metadata>
Aug 15 07:15:21 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:15:21 user nova-compute[72803]:     <system>
Aug 15 07:15:21 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:15:21 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:15:21 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:15:21 user nova-compute[72803]:       <entry name="serial">489f8bb1-12d2-4ba7-892a-b0906114b572</entry>
Aug 15 07:15:21 user nova-compute[72803]:       <entry name="uuid">489f8bb1-12d2-4ba7-892a-b0906114b572</entry>
Aug 15 07:15:21 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:15:21 user nova-compute[72803]:     </system>
Aug 15 07:15:21 user nova-compute[72803]:   </sysinfo>
Aug 15 07:15:21 user nova-compute[72803]:   <os>
Aug 15 07:15:21 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:15:21 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:15:21 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:15:21 user nova-compute[72803]:   </os>
Aug 15 07:15:21 user nova-compute[72803]:   <features>
Aug 15 07:15:21 user nova-compute[72803]:     <acpi/>
Aug 15 07:15:21 user nova-compute[72803]:     <apic/>
Aug 15 07:15:21 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:15:21 user nova-compute[72803]:   </features>
Aug 15 07:15:21 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:15:21 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:15:21 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:15:21 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:15:21 user nova-compute[72803]:   </clock>
Aug 15 07:15:21 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:15:21 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:15:21 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:15:21 user nova-compute[72803]:   </cpu>
Aug 15 07:15:21 user nova-compute[72803]:   <devices>
Aug 15 07:15:21 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:15:21 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:15:21 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk"/>
Aug 15 07:15:21 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:15:21 user nova-compute[72803]:     </disk>
Aug 15 07:15:21 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:15:21 user nova-compute[72803]:       <mac address="fa:16:3e:08:67:b9"/>
Aug 15 07:15:21 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:15:21 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:15:21 user nova-compute[72803]:       <target dev="tap11b0649b-f3"/>
Aug 15 07:15:21 user nova-compute[72803]:     </interface>
Aug 15 07:15:21 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:15:21 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/console.log" append="off"/>
Aug 15 07:15:21 user nova-compute[72803]:     </serial>
Aug 15 07:15:21 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:15:21 user nova-compute[72803]:     <video>
Aug 15 07:15:21 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:15:21 user nova-compute[72803]:     </video>
Aug 15 07:15:21 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:15:21 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:15:21 user nova-compute[72803]:     </rng>
Aug 15 07:15:21 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:15:21 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:15:21 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:15:21 user nova-compute[72803]:     </memballoon>
Aug 15 07:15:21 user nova-compute[72803]:   </devices>
Aug 15 07:15:21 user nova-compute[72803]: </domain>
Aug 15 07:15:21 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2035112338',display_name='tempest-TestStampPattern-server-2035112338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2035112338',id=38,image_ref='536f4974-b4c1-4128-b487-bdc42061f503',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYEdS660yr6zgAKFBXVbvLxAfpYjVGFPDW51c3q4Ydsz8Eye3gBE8udzyAe91FO7kCB6FzhaCGWoXBMPYW0RCVxd9Mg8nCu2yJHA/4Si/grKlEE/CLjLGwDhuMUdNTz9w==',key_name='tempest-TestStampPattern-1230572878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adb2074606144e48a856a092c7e32781',ramdisk_id='',reservation_id='r-jdjdwloo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8d0be6c9-8e93-4a50-bf2b-d287e619b303',image_min_disk='1',image_min_ram='0',image_owner_id='adb2074606144e48a856a092c7e32781',image_owner_project_name='tempest-TestStampPattern-1675165439',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1675165439-project-member',image_user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',network_allocated='True',owner_project_name='tempest-TestStampPattern-1675165439',owner_user_name='tempest-TestStampPattern-1675165439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:15:19Z,user_data=None,user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',uuid=489f8bb1-12d2-4ba7-892a-b0906114b572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converting VIF {"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=11b0649b-f346-475d-9d6e-c89efcc4418d,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b0649b-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG os_vif [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=11b0649b-f346-475d-9d6e-c89efcc4418d,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b0649b-f3') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11b0649b-f3, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11b0649b-f3, col_values=(('external_ids', {'iface-id': '11b0649b-f346-475d-9d6e-c89efcc4418d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:67:b9', 'vm-uuid': '489f8bb1-12d2-4ba7-892a-b0906114b572'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:21 user nova-compute[72803]: INFO os_vif [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=11b0649b-f346-475d-9d6e-c89efcc4418d,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b0649b-f3')
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:15:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No VIF found with MAC fa:16:3e:08:67:b9, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:15:22 user nova-compute[72803]: DEBUG nova.network.neutron [req-11c4ed7e-561a-43c5-86c6-658700fed6f5 req-b65fa91c-fd4d-4fee-9b67-e4cfd1a6b355 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updated VIF entry in instance network info cache for port 11b0649b-f346-475d-9d6e-c89efcc4418d. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:15:22 user nova-compute[72803]: DEBUG nova.network.neutron [req-11c4ed7e-561a-43c5-86c6-658700fed6f5 req-b65fa91c-fd4d-4fee-9b67-e4cfd1a6b355 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updating instance_info_cache with network_info: [{"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:15:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-11c4ed7e-561a-43c5-86c6-658700fed6f5 req-b65fa91c-fd4d-4fee-9b67-e4cfd1a6b355 service nova] Releasing lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:15:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-d8fbcf6b-96d6-4627-bbc9-af3324cddeb0 req-37ad1c9f-fe80-4d7b-bf1e-5f7984fa1b96 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:15:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d8fbcf6b-96d6-4627-bbc9-af3324cddeb0 req-37ad1c9f-fe80-4d7b-bf1e-5f7984fa1b96 service nova] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d8fbcf6b-96d6-4627-bbc9-af3324cddeb0 req-37ad1c9f-fe80-4d7b-bf1e-5f7984fa1b96 service nova] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d8fbcf6b-96d6-4627-bbc9-af3324cddeb0 req-37ad1c9f-fe80-4d7b-bf1e-5f7984fa1b96 service nova] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-d8fbcf6b-96d6-4627-bbc9-af3324cddeb0 req-37ad1c9f-fe80-4d7b-bf1e-5f7984fa1b96 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] No waiting events found dispatching network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:15:23 user nova-compute[72803]: WARNING nova.compute.manager [req-d8fbcf6b-96d6-4627-bbc9-af3324cddeb0 req-37ad1c9f-fe80-4d7b-bf1e-5f7984fa1b96 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received unexpected event network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d for instance with vm_state building and task_state spawning.
Aug 15 07:15:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083725.2379687, 489f8bb1-12d2-4ba7-892a-b0906114b572 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:15:25 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] VM Resumed (Lifecycle Event)
Aug 15 07:15:25 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Instance spawned successfully.
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-a7ce7cec-ef0f-491c-a6eb-b706f2386359 req-18333791-abd2-41ba-ad9b-2c27911f86c0 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a7ce7cec-ef0f-491c-a6eb-b706f2386359 req-18333791-abd2-41ba-ad9b-2c27911f86c0 service nova] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a7ce7cec-ef0f-491c-a6eb-b706f2386359 req-18333791-abd2-41ba-ad9b-2c27911f86c0 service nova] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a7ce7cec-ef0f-491c-a6eb-b706f2386359 req-18333791-abd2-41ba-ad9b-2c27911f86c0 service nova] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-a7ce7cec-ef0f-491c-a6eb-b706f2386359 req-18333791-abd2-41ba-ad9b-2c27911f86c0 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] No waiting events found dispatching network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:15:25 user nova-compute[72803]: WARNING nova.compute.manager [req-a7ce7cec-ef0f-491c-a6eb-b706f2386359 req-18333791-abd2-41ba-ad9b-2c27911f86c0 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received unexpected event network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d for instance with vm_state building and task_state spawning.
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:15:25 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083725.2405074, 489f8bb1-12d2-4ba7-892a-b0906114b572 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:15:25 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] VM Started (Lifecycle Event)
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:15:25 user nova-compute[72803]: INFO nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 15 07:15:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:15:25 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:15:25 user nova-compute[72803]: INFO nova.compute.manager [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Took 7.27 seconds to build instance.
Aug 15 07:15:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fefce63d-9e01-483c-80c1-27476cd970cb tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.393s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:15:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:41 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:15:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:47 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:48 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:15:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:15:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:15:48 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updating instance_info_cache with network_info: [{"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:15:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:15:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:53 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:15:53 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8100MB free_disk=25.28940200805664GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 57078f15-a8c6-4603-b158-3339af0cb88c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 489f8bb1-12d2-4ba7-892a-b0906114b572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:15:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:15:54 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:15:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:15:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:16:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:16:06 user nova-compute[72803]: INFO nova.compute.claims [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Claim successful on node user
Aug 15 07:16:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:16:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.policy [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '580a8d3496704b25b33f67cfb21e6d5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2fb93a370a4fa0badb369280adb602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:16:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Creating image(s)
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.224s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk 1073741824" returned: 0 in 0.062s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.238s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Cannot resize image /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'migration_context' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Ensure instance console log exists: /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:16:08 user nova-compute[72803]: INFO nova.compute.claims [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Claim successful on node user
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Successfully created port: f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:16:08 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:16:09 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:16:09 user nova-compute[72803]: INFO nova.virt.block_device [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Booting with volume 84e9ec09-cb51-4a19-aff9-6712b7491d87 at /dev/vda
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.policy [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d7a7a87dbd1449fb70b8851cf543e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3206b2e9c924b49becaa2ff5b4115e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "57078f15-a8c6-4603-b158-3339af0cb88c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:09 user nova-compute[72803]: INFO nova.compute.manager [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Terminating instance
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG os_brick.utils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e6dbb9-21e2-4b28-8b0b-6cbd450be0f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf3f66f-b93c-403e-a8e9-fd0feb698dd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e0d51-20ef-4427-9996-fafa39ed9b17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c41b64-32cd-41ad-ae4c-286d8edaa03c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:16:09 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[919329f3-f795-4807-ae08-6a9938f218cb]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG os_brick.utils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updating existing volume attachment record: 0ae3c6eb-1876-4dc1-b086-9ee7b023c914 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Successfully updated port: f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquired lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-9d7b251b-bd64-4df8-93d4-7bb26851a541 req-012f7e14-cef6-40e3-abeb-39dc57dfd2a2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-changed-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-9d7b251b-bd64-4df8-93d4-7bb26851a541 req-012f7e14-cef6-40e3-abeb-39dc57dfd2a2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Refreshing instance network info cache due to event network-changed-f2cc6417-2234-4954-b1a8-d51f14da390f. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d7b251b-bd64-4df8-93d4-7bb26851a541 req-012f7e14-cef6-40e3-abeb-39dc57dfd2a2 service nova] Acquiring lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-a6556925-9c5f-40f6-98bf-73a7ad46e9ba req-b9b30de2-0642-48a3-af0d-7ab3426f62bc service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-vif-unplugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a6556925-9c5f-40f6-98bf-73a7ad46e9ba req-b9b30de2-0642-48a3-af0d-7ab3426f62bc service nova] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a6556925-9c5f-40f6-98bf-73a7ad46e9ba req-b9b30de2-0642-48a3-af0d-7ab3426f62bc service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a6556925-9c5f-40f6-98bf-73a7ad46e9ba req-b9b30de2-0642-48a3-af0d-7ab3426f62bc service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-a6556925-9c5f-40f6-98bf-73a7ad46e9ba req-b9b30de2-0642-48a3-af0d-7ab3426f62bc service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] No waiting events found dispatching network-vif-unplugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-a6556925-9c5f-40f6-98bf-73a7ad46e9ba req-b9b30de2-0642-48a3-af0d-7ab3426f62bc service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-vif-unplugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Instance destroyed successfully.
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lazy-loading 'resources' on Instance uuid 57078f15-a8c6-4603-b158-3339af0cb88c {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:14:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-166883018',display_name='tempest-VolumesActionsTest-instance-166883018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-166883018',id=37,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:14:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c703e687f99045339795915d5dff031e',ramdisk_id='',reservation_id='r-5aaihue2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1941402153',owner_user_name='tempest-VolumesActionsTest-1941402153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:14:25Z,user_data=None,user_id='9b510bc4a21940ae904886cfeaa8e29f',uuid=57078f15-a8c6-4603-b158-3339af0cb88c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converting VIF {"id": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "address": "fa:16:3e:77:e6:6d", "network": {"id": "ac28245a-2e6e-4b75-84be-2beca9f644aa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-476323720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c703e687f99045339795915d5dff031e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbedd7958-9e", "ovs_interfaceid": "bedd7958-9e70-4158-b334-ebd6cf98d9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e6:6d,bridge_name='br-int',has_traffic_filtering=True,id=bedd7958-9e70-4158-b334-ebd6cf98d9a3,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbedd7958-9e') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG os_vif [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e6:6d,bridge_name='br-int',has_traffic_filtering=True,id=bedd7958-9e70-4158-b334-ebd6cf98d9a3,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbedd7958-9e') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbedd7958-9e, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:16:10 user nova-compute[72803]: INFO os_vif [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e6:6d,bridge_name='br-int',has_traffic_filtering=True,id=bedd7958-9e70-4158-b334-ebd6cf98d9a3,network=Network(ac28245a-2e6e-4b75-84be-2beca9f644aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbedd7958-9e')
Aug 15 07:16:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Deleting instance files /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c_del
Aug 15 07:16:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Deletion of /opt/stack/data/nova/instances/57078f15-a8c6-4603-b158-3339af0cb88c_del complete
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Releasing lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance network_info: |[{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d7b251b-bd64-4df8-93d4-7bb26851a541 req-012f7e14-cef6-40e3-abeb-39dc57dfd2a2 service nova] Acquired lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d7b251b-bd64-4df8-93d4-7bb26851a541 req-012f7e14-cef6-40e3-abeb-39dc57dfd2a2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Refreshing network info cache for port f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Start _get_guest_xml network_info=[{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:16:10 user nova-compute[72803]: INFO nova.compute.manager [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Took 0.81 seconds to destroy the instance on the hypervisor.
Aug 15 07:16:10 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:16:10 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:16:10 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2114399517',display_name='tempest-ServerStableDeviceRescueTest-server-2114399517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2114399517',id=39,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH3mRkT28QKSLpSuGqX9AbaFPnxcddlyqDTSGZ9EFwfhLJPio+bIowVDYW2fMsqSTRbt/7DHWSCvTNsOd68YHCEGyZujDOlZntS5tJ4k2VXhpBokRvJxeGYOLUESSDlvg==',key_name='tempest-keypair-1111085751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2fb93a370a4fa0badb369280adb602',ramdisk_id='',reservation_id='r-6iw9rbgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-473594700',owner_user_name='tempest-ServerStableDeviceRescueTest-473594700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580a8d3496704b25b33f67cfb21e6d5b',uuid=f9b55b06-8a65-4202-b494-f4261c872f62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Converting VIF {"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2cc6417-2234-4954-b1a8-d51f14da390f,network=Network(6192a07b-dedb-4cf9-8538-7c722b450542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cc6417-22') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'pci_devices' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:16:10 user nova-compute[72803]:   <uuid>f9b55b06-8a65-4202-b494-f4261c872f62</uuid>
Aug 15 07:16:10 user nova-compute[72803]:   <name>instance-00000027</name>
Aug 15 07:16:10 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:16:10 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:16:10 user nova-compute[72803]:   <metadata>
Aug 15 07:16:10 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:16:10 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:16:10 user nova-compute[72803]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2114399517</nova:name>
Aug 15 07:16:10 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:16:10</nova:creationTime>
Aug 15 07:16:10 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:16:10 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:16:10 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:16:10 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:16:10 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:16:10 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:16:10 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:16:10 user nova-compute[72803]:       <nova:owner>
Aug 15 07:16:10 user nova-compute[72803]:         <nova:user uuid="580a8d3496704b25b33f67cfb21e6d5b">tempest-ServerStableDeviceRescueTest-473594700-project-member</nova:user>
Aug 15 07:16:10 user nova-compute[72803]:         <nova:project uuid="ee2fb93a370a4fa0badb369280adb602">tempest-ServerStableDeviceRescueTest-473594700</nova:project>
Aug 15 07:16:10 user nova-compute[72803]:       </nova:owner>
Aug 15 07:16:10 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:16:10 user nova-compute[72803]:       <nova:ports>
Aug 15 07:16:10 user nova-compute[72803]:         <nova:port uuid="f2cc6417-2234-4954-b1a8-d51f14da390f">
Aug 15 07:16:10 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 07:16:10 user nova-compute[72803]:         </nova:port>
Aug 15 07:16:10 user nova-compute[72803]:       </nova:ports>
Aug 15 07:16:10 user nova-compute[72803]:     </nova:instance>
Aug 15 07:16:10 user nova-compute[72803]:   </metadata>
Aug 15 07:16:10 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:16:10 user nova-compute[72803]:     <system>
Aug 15 07:16:10 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:16:10 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:16:10 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:16:10 user nova-compute[72803]:       <entry name="serial">f9b55b06-8a65-4202-b494-f4261c872f62</entry>
Aug 15 07:16:10 user nova-compute[72803]:       <entry name="uuid">f9b55b06-8a65-4202-b494-f4261c872f62</entry>
Aug 15 07:16:10 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:16:10 user nova-compute[72803]:     </system>
Aug 15 07:16:10 user nova-compute[72803]:   </sysinfo>
Aug 15 07:16:10 user nova-compute[72803]:   <os>
Aug 15 07:16:10 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:16:10 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:16:10 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:16:10 user nova-compute[72803]:   </os>
Aug 15 07:16:10 user nova-compute[72803]:   <features>
Aug 15 07:16:10 user nova-compute[72803]:     <acpi/>
Aug 15 07:16:10 user nova-compute[72803]:     <apic/>
Aug 15 07:16:10 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:16:10 user nova-compute[72803]:   </features>
Aug 15 07:16:10 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:16:10 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:16:10 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:16:10 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:16:10 user nova-compute[72803]:   </clock>
Aug 15 07:16:10 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:16:10 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:16:10 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:16:10 user nova-compute[72803]:   </cpu>
Aug 15 07:16:10 user nova-compute[72803]:   <devices>
Aug 15 07:16:10 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:16:10 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:16:10 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk"/>
Aug 15 07:16:10 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:16:10 user nova-compute[72803]:     </disk>
Aug 15 07:16:10 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:16:10 user nova-compute[72803]:       <mac address="fa:16:3e:f0:3c:bc"/>
Aug 15 07:16:10 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:16:10 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:16:10 user nova-compute[72803]:       <target dev="tapf2cc6417-22"/>
Aug 15 07:16:10 user nova-compute[72803]:     </interface>
Aug 15 07:16:10 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:16:10 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/console.log" append="off"/>
Aug 15 07:16:10 user nova-compute[72803]:     </serial>
Aug 15 07:16:10 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:16:10 user nova-compute[72803]:     <video>
Aug 15 07:16:10 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:16:10 user nova-compute[72803]:     </video>
Aug 15 07:16:10 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:16:10 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:16:10 user nova-compute[72803]:     </rng>
Aug 15 07:16:10 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:16:10 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:16:10 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:16:10 user nova-compute[72803]:     </memballoon>
Aug 15 07:16:10 user nova-compute[72803]:   </devices>
Aug 15 07:16:10 user nova-compute[72803]: </domain>
Aug 15 07:16:10 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2114399517',display_name='tempest-ServerStableDeviceRescueTest-server-2114399517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2114399517',id=39,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH3mRkT28QKSLpSuGqX9AbaFPnxcddlyqDTSGZ9EFwfhLJPio+bIowVDYW2fMsqSTRbt/7DHWSCvTNsOd68YHCEGyZujDOlZntS5tJ4k2VXhpBokRvJxeGYOLUESSDlvg==',key_name='tempest-keypair-1111085751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2fb93a370a4fa0badb369280adb602',ramdisk_id='',reservation_id='r-6iw9rbgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-473594700',owner_user_name='tempest-ServerStableDeviceRescueTest-473594700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580a8d3496704b25b33f67cfb21e6d5b',uuid=f9b55b06-8a65-4202-b494-f4261c872f62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Converting VIF {"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2cc6417-2234-4954-b1a8-d51f14da390f,network=Network(6192a07b-dedb-4cf9-8538-7c722b450542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cc6417-22') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG os_vif [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2cc6417-2234-4954-b1a8-d51f14da390f,network=Network(6192a07b-dedb-4cf9-8538-7c722b450542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cc6417-22') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2cc6417-22, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2cc6417-22, col_values=(('external_ids', {'iface-id': 'f2cc6417-2234-4954-b1a8-d51f14da390f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:3c:bc', 'vm-uuid': 'f9b55b06-8a65-4202-b494-f4261c872f62'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: INFO os_vif [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2cc6417-2234-4954-b1a8-d51f14da390f,network=Network(6192a07b-dedb-4cf9-8538-7c722b450542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cc6417-22')
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No VIF found with MAC fa:16:3e:f0:3c:bc, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d7b251b-bd64-4df8-93d4-7bb26851a541 req-012f7e14-cef6-40e3-abeb-39dc57dfd2a2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updated VIF entry in instance network info cache for port f2cc6417-2234-4954-b1a8-d51f14da390f. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d7b251b-bd64-4df8-93d4-7bb26851a541 req-012f7e14-cef6-40e3-abeb-39dc57dfd2a2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Successfully created port: 19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:16:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d7b251b-bd64-4df8-93d4-7bb26851a541 req-012f7e14-cef6-40e3-abeb-39dc57dfd2a2 service nova] Releasing lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:16:11 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Took 1.17 seconds to deallocate network for instance.
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-84437001-8244-4a88-8561-f722713daeb5 req-b4223981-500f-4848-b501-6d0ecc68e872 service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-vif-deleted-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:11 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Deleted allocations for instance 57078f15-a8c6-4603-b158-3339af0cb88c
Aug 15 07:16:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] No waiting events found dispatching network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:16:11 user nova-compute[72803]: WARNING nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received unexpected event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 for instance with vm_state deleted and task_state None.
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] No waiting events found dispatching network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:16:11 user nova-compute[72803]: WARNING nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received unexpected event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 for instance with vm_state deleted and task_state None.
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Acquiring lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] Lock "57078f15-a8c6-4603-b158-3339af0cb88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] No waiting events found dispatching network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:16:11 user nova-compute[72803]: WARNING nova.compute.manager [req-4f353220-55a5-4058-a4f6-4b7a8b744bd5 req-3bf803c4-2a88-4b4f-bc1f-5292c57a5c1d service nova] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Received unexpected event network-vif-plugged-bedd7958-9e70-4158-b334-ebd6cf98d9a3 for instance with vm_state deleted and task_state None.
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8c90e9f9-e871-4d01-bca7-05981b040a84 tempest-VolumesActionsTest-1941402153 tempest-VolumesActionsTest-1941402153-project-member] Lock "57078f15-a8c6-4603-b158-3339af0cb88c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.545s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Successfully updated port: 19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquired lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:16:11 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-4156d23f-a625-4288-8ee5-232947024105 req-c0104c8f-d271-4751-bfa3-f623854aeae2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4156d23f-a625-4288-8ee5-232947024105 req-c0104c8f-d271-4751-bfa3-f623854aeae2 service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4156d23f-a625-4288-8ee5-232947024105 req-c0104c8f-d271-4751-bfa3-f623854aeae2 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4156d23f-a625-4288-8ee5-232947024105 req-c0104c8f-d271-4751-bfa3-f623854aeae2 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-4156d23f-a625-4288-8ee5-232947024105 req-c0104c8f-d271-4751-bfa3-f623854aeae2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:16:12 user nova-compute[72803]: WARNING nova.compute.manager [req-4156d23f-a625-4288-8ee5-232947024105 req-c0104c8f-d271-4751-bfa3-f623854aeae2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state building and task_state spawning.
Aug 15 07:16:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updating instance_info_cache with network_info: [{"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Releasing lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance network_info: |[{"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-7d1c09ea-4467-4db6-bde4-619c7cfca7f0 req-73766dbb-da3b-40ef-a63c-9e35abf7dff0 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-changed-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-7d1c09ea-4467-4db6-bde4-619c7cfca7f0 req-73766dbb-da3b-40ef-a63c-9e35abf7dff0 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Refreshing instance network info cache due to event network-changed-19186478-2d79-4d93-9af5-bca0fdea4c79. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7d1c09ea-4467-4db6-bde4-619c7cfca7f0 req-73766dbb-da3b-40ef-a63c-9e35abf7dff0 service nova] Acquiring lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7d1c09ea-4467-4db6-bde4-619c7cfca7f0 req-73766dbb-da3b-40ef-a63c-9e35abf7dff0 service nova] Acquired lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.network.neutron [req-7d1c09ea-4467-4db6-bde4-619c7cfca7f0 req-73766dbb-da3b-40ef-a63c-9e35abf7dff0 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Refreshing network info cache for port 19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083773.884267, f9b55b06-8a65-4202-b494-f4261c872f62 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:16:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] VM Resumed (Lifecycle Event)
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:16:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance spawned successfully.
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083773.8881502, f9b55b06-8a65-4202-b494-f4261c872f62 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:16:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] VM Started (Lifecycle Event)
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:16:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:16:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:16:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 15 07:16:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:16:14 user nova-compute[72803]: INFO nova.compute.manager [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Took 7.36 seconds to build instance.
Aug 15 07:16:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-a0075803-3231-4ce0-b917-b62b391dfd9e req-74b94e08-8f94-4a67-be77-cb5bbac90e80 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a0075803-3231-4ce0-b917-b62b391dfd9e req-74b94e08-8f94-4a67-be77-cb5bbac90e80 service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a0075803-3231-4ce0-b917-b62b391dfd9e req-74b94e08-8f94-4a67-be77-cb5bbac90e80 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a0075803-3231-4ce0-b917-b62b391dfd9e req-74b94e08-8f94-4a67-be77-cb5bbac90e80 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-a0075803-3231-4ce0-b917-b62b391dfd9e req-74b94e08-8f94-4a67-be77-cb5bbac90e80 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:16:14 user nova-compute[72803]: WARNING nova.compute.manager [req-a0075803-3231-4ce0-b917-b62b391dfd9e req-74b94e08-8f94-4a67-be77-cb5bbac90e80 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state active and task_state None.
Aug 15 07:16:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3dc0911e-8467-42ee-ac3d-2ead970d5909 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.472s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:14 user nova-compute[72803]: DEBUG nova.network.neutron [req-7d1c09ea-4467-4db6-bde4-619c7cfca7f0 req-73766dbb-da3b-40ef-a63c-9e35abf7dff0 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updated VIF entry in instance network info cache for port 19186478-2d79-4d93-9af5-bca0fdea4c79. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:16:14 user nova-compute[72803]: DEBUG nova.network.neutron [req-7d1c09ea-4467-4db6-bde4-619c7cfca7f0 req-73766dbb-da3b-40ef-a63c-9e35abf7dff0 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updating instance_info_cache with network_info: [{"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:16:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7d1c09ea-4467-4db6-bde4-619c7cfca7f0 req-73766dbb-da3b-40ef-a63c-9e35abf7dff0 service nova] Releasing lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:16:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:16:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Creating image(s)
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Ensure instance console log exists: /opt/stack/data/nova/instances/632fdd77-c7d3-493b-b8b2-e1a16296fdaa/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Start _get_guest_xml network_info=[{"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '0ae3c6eb-1876-4dc1-b086-9ee7b023c914', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '632fdd77-c7d3-493b-b8b2-e1a16296fdaa', 'attached_at': '', 'detached_at': '', 'volume_id': '84e9ec09-cb51-4a19-aff9-6712b7491d87', 'serial': '84e9ec09-cb51-4a19-aff9-6712b7491d87'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:16:18 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:16:18 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:16:18 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:16:18 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:16:18 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[22915835-1d7c-4520-a2ce-6f0688594574]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:16:18 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4d8b9b-9e54-48dc-86ad-9ddea727c7b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87] added
Aug 15 07:16:18 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb2b1c1-33d3-46b0-99df-44e5b867c4ea]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4bbbe6-3428-4196-92e4-0772445fa0d3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrAXadlv {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrAXadlv" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[46021846-868c-4736-bb2b-27cc3a032137]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrAXadlv'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4a7957-c8b7-47e4-b827-ef0415a1a145]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e47a78-c8b6-4de2-905d-5f4128a76495]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:16:18 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:16:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:16:18 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:16:18 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 07:16:18 user nova-compute[72803]: 
Aug 15 07:16:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cad87b7-0ab1-4605-a37d-ec5ce591b24d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260]
Aug 15 07:16:19 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260] successful.
Aug 15 07:16:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[051ab65e-5def-4b03-9729-373bfa5f5909]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de0115d-b0c1-4633-9b22-2253482ad34f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:16:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:16:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a1372d-3a9d-45ca-8202-0aac6a187e5f]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:16:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23233313639373232', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233313639373232', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-304935621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-304935621',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9k45/rjpORVh8DYFQ+KcXU5YHBpSbUhTXZlH0Hus32rGVDK580Ryh6t9TFdKiNSDa8Bo8DYL8/TgERDhP7eJUf/qR3DM5r75WovgrSvzC2twKY3xRO2iXmBFEalcyFmQ==',key_name='tempest-keypair-637292857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3206b2e9c924b49becaa2ff5b4115e4',ramdisk_id='',reservation_id='r-im66e1d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1796571112',owner_user_name='tempest-ServerActionsV293TestJSON-1796571112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d7a7a87dbd1449fb70b8851cf543e42',uuid=632fdd77-c7d3-493b-b8b2-e1a16296fdaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converting VIF {"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lazy-loading 'pci_devices' on Instance uuid 632fdd77-c7d3-493b-b8b2-e1a16296fdaa {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:16:20 user nova-compute[72803]:   <uuid>632fdd77-c7d3-493b-b8b2-e1a16296fdaa</uuid>
Aug 15 07:16:20 user nova-compute[72803]:   <name>instance-00000028</name>
Aug 15 07:16:20 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:16:20 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:16:20 user nova-compute[72803]:   <metadata>
Aug 15 07:16:20 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:16:20 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:16:20 user nova-compute[72803]:       <nova:name>tempest-ServerActionsV293TestJSON-server-304935621</nova:name>
Aug 15 07:16:20 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:16:18</nova:creationTime>
Aug 15 07:16:20 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:16:20 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:16:20 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:16:20 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:16:20 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:16:20 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:16:20 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:16:20 user nova-compute[72803]:       <nova:owner>
Aug 15 07:16:20 user nova-compute[72803]:         <nova:user uuid="4d7a7a87dbd1449fb70b8851cf543e42">tempest-ServerActionsV293TestJSON-1796571112-project-member</nova:user>
Aug 15 07:16:20 user nova-compute[72803]:         <nova:project uuid="a3206b2e9c924b49becaa2ff5b4115e4">tempest-ServerActionsV293TestJSON-1796571112</nova:project>
Aug 15 07:16:20 user nova-compute[72803]:       </nova:owner>
Aug 15 07:16:20 user nova-compute[72803]:       <nova:ports>
Aug 15 07:16:20 user nova-compute[72803]:         <nova:port uuid="19186478-2d79-4d93-9af5-bca0fdea4c79">
Aug 15 07:16:20 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 07:16:20 user nova-compute[72803]:         </nova:port>
Aug 15 07:16:20 user nova-compute[72803]:       </nova:ports>
Aug 15 07:16:20 user nova-compute[72803]:     </nova:instance>
Aug 15 07:16:20 user nova-compute[72803]:   </metadata>
Aug 15 07:16:20 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:16:20 user nova-compute[72803]:     <system>
Aug 15 07:16:20 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:16:20 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:16:20 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:16:20 user nova-compute[72803]:       <entry name="serial">632fdd77-c7d3-493b-b8b2-e1a16296fdaa</entry>
Aug 15 07:16:20 user nova-compute[72803]:       <entry name="uuid">632fdd77-c7d3-493b-b8b2-e1a16296fdaa</entry>
Aug 15 07:16:20 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:16:20 user nova-compute[72803]:     </system>
Aug 15 07:16:20 user nova-compute[72803]:   </sysinfo>
Aug 15 07:16:20 user nova-compute[72803]:   <os>
Aug 15 07:16:20 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:16:20 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:16:20 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:16:20 user nova-compute[72803]:   </os>
Aug 15 07:16:20 user nova-compute[72803]:   <features>
Aug 15 07:16:20 user nova-compute[72803]:     <acpi/>
Aug 15 07:16:20 user nova-compute[72803]:     <apic/>
Aug 15 07:16:20 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:16:20 user nova-compute[72803]:   </features>
Aug 15 07:16:20 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:16:20 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:16:20 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:16:20 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:16:20 user nova-compute[72803]:   </clock>
Aug 15 07:16:20 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:16:20 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:16:20 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:16:20 user nova-compute[72803]:   </cpu>
Aug 15 07:16:20 user nova-compute[72803]:   <devices>
Aug 15 07:16:20 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:16:20 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:16:20 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 07:16:20 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:16:20 user nova-compute[72803]:       <serial>84e9ec09-cb51-4a19-aff9-6712b7491d87</serial>
Aug 15 07:16:20 user nova-compute[72803]:     </disk>
Aug 15 07:16:20 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:16:20 user nova-compute[72803]:       <mac address="fa:16:3e:59:61:90"/>
Aug 15 07:16:20 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:16:20 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:16:20 user nova-compute[72803]:       <target dev="tap19186478-2d"/>
Aug 15 07:16:20 user nova-compute[72803]:     </interface>
Aug 15 07:16:20 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:16:20 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/632fdd77-c7d3-493b-b8b2-e1a16296fdaa/console.log" append="off"/>
Aug 15 07:16:20 user nova-compute[72803]:     </serial>
Aug 15 07:16:20 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:16:20 user nova-compute[72803]:     <video>
Aug 15 07:16:20 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:16:20 user nova-compute[72803]:     </video>
Aug 15 07:16:20 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:16:20 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:16:20 user nova-compute[72803]:     </rng>
Aug 15 07:16:20 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:16:20 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:16:20 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:16:20 user nova-compute[72803]:     </memballoon>
Aug 15 07:16:20 user nova-compute[72803]:   </devices>
Aug 15 07:16:20 user nova-compute[72803]: </domain>
Aug 15 07:16:20 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-304935621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-304935621',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9k45/rjpORVh8DYFQ+KcXU5YHBpSbUhTXZlH0Hus32rGVDK580Ryh6t9TFdKiNSDa8Bo8DYL8/TgERDhP7eJUf/qR3DM5r75WovgrSvzC2twKY3xRO2iXmBFEalcyFmQ==',key_name='tempest-keypair-637292857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3206b2e9c924b49becaa2ff5b4115e4',ramdisk_id='',reservation_id='r-im66e1d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1796571112',owner_user_name='tempest-ServerActionsV293TestJSON-1796571112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d7a7a87dbd1449fb70b8851cf543e42',uuid=632fdd77-c7d3-493b-b8b2-e1a16296fdaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converting VIF {"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG os_vif [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19186478-2d, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19186478-2d, col_values=(('external_ids', {'iface-id': '19186478-2d79-4d93-9af5-bca0fdea4c79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:61:90', 'vm-uuid': '632fdd77-c7d3-493b-b8b2-e1a16296fdaa'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:20 user nova-compute[72803]: INFO os_vif [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d')
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:16:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] No VIF found with MAC fa:16:3e:59:61:90, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-6edd6555-9709-451a-8388-5aadff0ec29d req-cc4dbdc9-8f21-48ab-af4d-31588534bc83 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6edd6555-9709-451a-8388-5aadff0ec29d req-cc4dbdc9-8f21-48ab-af4d-31588534bc83 service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6edd6555-9709-451a-8388-5aadff0ec29d req-cc4dbdc9-8f21-48ab-af4d-31588534bc83 service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6edd6555-9709-451a-8388-5aadff0ec29d req-cc4dbdc9-8f21-48ab-af4d-31588534bc83 service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-6edd6555-9709-451a-8388-5aadff0ec29d req-cc4dbdc9-8f21-48ab-af4d-31588534bc83 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] No waiting events found dispatching network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:16:21 user nova-compute[72803]: WARNING nova.compute.manager [req-6edd6555-9709-451a-8388-5aadff0ec29d req-cc4dbdc9-8f21-48ab-af4d-31588534bc83 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received unexpected event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 for instance with vm_state building and task_state spawning.
Aug 15 07:16:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-a83d1231-b546-4759-8269-b2f1ec570336 req-22fefd0c-be21-4c4e-9848-066c628a8d5e service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:16:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a83d1231-b546-4759-8269-b2f1ec570336 req-22fefd0c-be21-4c4e-9848-066c628a8d5e service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a83d1231-b546-4759-8269-b2f1ec570336 req-22fefd0c-be21-4c4e-9848-066c628a8d5e service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a83d1231-b546-4759-8269-b2f1ec570336 req-22fefd0c-be21-4c4e-9848-066c628a8d5e service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-a83d1231-b546-4759-8269-b2f1ec570336 req-22fefd0c-be21-4c4e-9848-066c628a8d5e service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] No waiting events found dispatching network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:16:23 user nova-compute[72803]: WARNING nova.compute.manager [req-a83d1231-b546-4759-8269-b2f1ec570336 req-22fefd0c-be21-4c4e-9848-066c628a8d5e service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received unexpected event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 for instance with vm_state building and task_state spawning.
Aug 15 07:16:23 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083783.9969668, 632fdd77-c7d3-493b-b8b2-e1a16296fdaa => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:16:23 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] VM Resumed (Lifecycle Event)
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:16:24 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance spawned successfully.
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:16:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083784.0004187, 632fdd77-c7d3-493b-b8b2-e1a16296fdaa => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:16:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] VM Started (Lifecycle Event)
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:16:24 user nova-compute[72803]: INFO nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:16:24 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:16:24 user nova-compute[72803]: INFO nova.compute.manager [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Took 15.65 seconds to build instance.
Aug 15 07:16:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-ad949e28-90fa-4016-8455-54e806cc0a90 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.784s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083769.9374316, 57078f15-a8c6-4603-b158-3339af0cb88c => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:16:24 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] VM Stopped (Lifecycle Event)
Aug 15 07:16:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7ec3a492-3ba0-4ca0-af0d-8e687a6a0ca9 None None] [instance: 57078f15-a8c6-4603-b158-3339af0cb88c] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:16:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:41 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:46 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:16:47 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:47 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:16:47 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:16:48 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:48 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:50 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:16:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:16:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:16:50 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:16:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:16:53 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:16:53 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:16:53 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=25.283119201660156GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:16:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:16:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 489f8bb1-12d2-4ba7-892a-b0906114b572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f9b55b06-8a65-4202-b494-f4261c872f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 632fdd77-c7d3-493b-b8b2-e1a16296fdaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:16:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:16:55 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:07 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-44656fcc-0514-4aec-8693-5ce3376b0cc8 req-96b8b6d4-4098-4d54-81a1-1db100931061 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-changed-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-44656fcc-0514-4aec-8693-5ce3376b0cc8 req-96b8b6d4-4098-4d54-81a1-1db100931061 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Refreshing instance network info cache due to event network-changed-11b0649b-f346-475d-9d6e-c89efcc4418d. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:17:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-44656fcc-0514-4aec-8693-5ce3376b0cc8 req-96b8b6d4-4098-4d54-81a1-1db100931061 service nova] Acquiring lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:17:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-44656fcc-0514-4aec-8693-5ce3376b0cc8 req-96b8b6d4-4098-4d54-81a1-1db100931061 service nova] Acquired lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:17:11 user nova-compute[72803]: DEBUG nova.network.neutron [req-44656fcc-0514-4aec-8693-5ce3376b0cc8 req-96b8b6d4-4098-4d54-81a1-1db100931061 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Refreshing network info cache for port 11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'flavor' on Instance uuid 489f8bb1-12d2-4ba7-892a-b0906114b572 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-44656fcc-0514-4aec-8693-5ce3376b0cc8 req-96b8b6d4-4098-4d54-81a1-1db100931061 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updated VIF entry in instance network info cache for port 11b0649b-f346-475d-9d6e-c89efcc4418d. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-44656fcc-0514-4aec-8693-5ce3376b0cc8 req-96b8b6d4-4098-4d54-81a1-1db100931061 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updating instance_info_cache with network_info: [{"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-44656fcc-0514-4aec-8693-5ce3376b0cc8 req-96b8b6d4-4098-4d54-81a1-1db100931061 service nova] Releasing lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:12 user nova-compute[72803]: INFO nova.compute.manager [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Attaching volume 948b521f-45cd-444d-aae3-e2b4bbe0ed9c to /dev/vdb
Aug 15 07:17:12 user nova-compute[72803]: DEBUG os_brick.utils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e4d5ee-ed58-4259-8f06-0368b9dd462e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[971e5241-821c-41d7-a692-c17e58e47aa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ab90f4-63b1-46be-9224-958e6b2b7224]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f55281-ed10-438e-bfec-2402048918ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:17:12 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:17:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91250f2-7b60-4e72-886b-d009041ed95d]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG os_brick.utils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:17:12 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updating existing volume attachment record: c0a9e3fb-21bc-4871-8db5-bde9306cdc0b {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:17:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:17:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:16 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:17:16 user nova-compute[72803]: INFO nova.compute.claims [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Claim successful on node user
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:17:17 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:17:17 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Creating image(s)
Aug 15 07:17:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "/opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "/opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "/opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.099s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "cb8d7654954d9a3578bd177a039a2d8c2c5ef236" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "cb8d7654954d9a3578bd177a039a2d8c2c5ef236" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:17 user nova-compute[72803]: DEBUG nova.policy [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76bdfb1f24e5432fbb1946ad1875a8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35db591e3ed243128111721ee0e6c276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:17:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236.part --force-share --output=json" returned: 0 in 0.206s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:18 user nova-compute[72803]: DEBUG nova.virt.images [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] e5761c4c-071a-4d72-938b-be1925849dcd was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 07:17:18 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:17:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236.part /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:18 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Successfully created port: ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:17:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Successfully updated port: ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236.part /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236.converted" returned: 0 in 1.990s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-bbf7c2df-d01c-43e2-847e-bf249600af5b req-a0a59425-0d5f-45e5-85e4-ad4e078a81b4 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-bbf7c2df-d01c-43e2-847e-bf249600af5b req-a0a59425-0d5f-45e5-85e4-ad4e078a81b4 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing instance network info cache due to event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bbf7c2df-d01c-43e2-847e-bf249600af5b req-a0a59425-0d5f-45e5-85e4-ad4e078a81b4 service nova] Acquiring lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bbf7c2df-d01c-43e2-847e-bf249600af5b req-a0a59425-0d5f-45e5-85e4-ad4e078a81b4 service nova] Acquired lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-bbf7c2df-d01c-43e2-847e-bf249600af5b req-a0a59425-0d5f-45e5-85e4-ad4e078a81b4 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-bbf7c2df-d01c-43e2-847e-bf249600af5b req-a0a59425-0d5f-45e5-85e4-ad4e078a81b4 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236.converted --force-share --output=json" returned: 0 in 0.312s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "cb8d7654954d9a3578bd177a039a2d8c2c5ef236" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.086s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 --force-share --output=json" returned: 0 in 0.233s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "cb8d7654954d9a3578bd177a039a2d8c2c5ef236" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "cb8d7654954d9a3578bd177a039a2d8c2c5ef236" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-bbf7c2df-d01c-43e2-847e-bf249600af5b req-a0a59425-0d5f-45e5-85e4-ad4e078a81b4 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bbf7c2df-d01c-43e2-847e-bf249600af5b req-a0a59425-0d5f-45e5-85e4-ad4e078a81b4 service nova] Releasing lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquired lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236,backing_fmt=raw /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236,backing_fmt=raw /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk 1073741824" returned: 0 in 0.154s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "cb8d7654954d9a3578bd177a039a2d8c2c5ef236" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 --force-share --output=json" returned: 0 in 0.196s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Cannot resize image /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'migration_context' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Ensure instance console log exists: /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating instance_info_cache with network_info: [{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Releasing lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance network_info: |[{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Start _get_guest_xml network_info=[{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T07:17:14Z,direct_url=<?>,disk_format='qcow2',id=e5761c4c-071a-4d72-938b-be1925849dcd,min_disk=0,min_ram=0,name='tempest-scenario-img--1733634901',owner='35db591e3ed243128111721ee0e6c276',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T07:17:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'e5761c4c-071a-4d72-938b-be1925849dcd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:17:22 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:17:22 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T07:17:14Z,direct_url=<?>,disk_format='qcow2',id=e5761c4c-071a-4d72-938b-be1925849dcd,min_disk=0,min_ram=0,name='tempest-scenario-img--1733634901',owner='35db591e3ed243128111721ee0e6c276',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T07:17:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-776555605',display_name='tempest-TestMinimumBasicScenario-server-776555605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-776555605',id=41,image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkG8deH+MspIOuSTtsx7S1v+ajnEtABiOWhmo6nYo6CQk5ilKRcV2ltjjvsnm6cm29/DmQyRETgiOoGbj5JLHScL/pb0/Q9tSENW0qlMy6o5W3IpjeOJplFowBjoQlvlw==',key_name='tempest-TestMinimumBasicScenario-1926102892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-8qtgi0gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:17:17Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=89e22ae0-9706-4295-9fdd-97a09b012328,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'pci_devices' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:17:22 user nova-compute[72803]:   <uuid>89e22ae0-9706-4295-9fdd-97a09b012328</uuid>
Aug 15 07:17:22 user nova-compute[72803]:   <name>instance-00000029</name>
Aug 15 07:17:22 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:17:22 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:17:22 user nova-compute[72803]:   <metadata>
Aug 15 07:17:22 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:17:22 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:17:22 user nova-compute[72803]:       <nova:name>tempest-TestMinimumBasicScenario-server-776555605</nova:name>
Aug 15 07:17:22 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:17:22</nova:creationTime>
Aug 15 07:17:22 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:17:22 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:17:22 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:17:22 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:17:22 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:17:22 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:17:22 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:17:22 user nova-compute[72803]:       <nova:owner>
Aug 15 07:17:22 user nova-compute[72803]:         <nova:user uuid="76bdfb1f24e5432fbb1946ad1875a8f9">tempest-TestMinimumBasicScenario-1832153355-project-member</nova:user>
Aug 15 07:17:22 user nova-compute[72803]:         <nova:project uuid="35db591e3ed243128111721ee0e6c276">tempest-TestMinimumBasicScenario-1832153355</nova:project>
Aug 15 07:17:22 user nova-compute[72803]:       </nova:owner>
Aug 15 07:17:22 user nova-compute[72803]:       <nova:root type="image" uuid="e5761c4c-071a-4d72-938b-be1925849dcd"/>
Aug 15 07:17:22 user nova-compute[72803]:       <nova:ports>
Aug 15 07:17:22 user nova-compute[72803]:         <nova:port uuid="ca02489e-f336-4167-97a6-cf56edc6c64b">
Aug 15 07:17:22 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:17:22 user nova-compute[72803]:         </nova:port>
Aug 15 07:17:22 user nova-compute[72803]:       </nova:ports>
Aug 15 07:17:22 user nova-compute[72803]:     </nova:instance>
Aug 15 07:17:22 user nova-compute[72803]:   </metadata>
Aug 15 07:17:22 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:17:22 user nova-compute[72803]:     <system>
Aug 15 07:17:22 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:17:22 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:17:22 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:17:22 user nova-compute[72803]:       <entry name="serial">89e22ae0-9706-4295-9fdd-97a09b012328</entry>
Aug 15 07:17:22 user nova-compute[72803]:       <entry name="uuid">89e22ae0-9706-4295-9fdd-97a09b012328</entry>
Aug 15 07:17:22 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:17:22 user nova-compute[72803]:     </system>
Aug 15 07:17:22 user nova-compute[72803]:   </sysinfo>
Aug 15 07:17:22 user nova-compute[72803]:   <os>
Aug 15 07:17:22 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:17:22 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:17:22 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:17:22 user nova-compute[72803]:   </os>
Aug 15 07:17:22 user nova-compute[72803]:   <features>
Aug 15 07:17:22 user nova-compute[72803]:     <acpi/>
Aug 15 07:17:22 user nova-compute[72803]:     <apic/>
Aug 15 07:17:22 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:17:22 user nova-compute[72803]:   </features>
Aug 15 07:17:22 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:17:22 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:17:22 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:17:22 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:17:22 user nova-compute[72803]:   </clock>
Aug 15 07:17:22 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:17:22 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:17:22 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:17:22 user nova-compute[72803]:   </cpu>
Aug 15 07:17:22 user nova-compute[72803]:   <devices>
Aug 15 07:17:22 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:17:22 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:17:22 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk"/>
Aug 15 07:17:22 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:17:22 user nova-compute[72803]:     </disk>
Aug 15 07:17:22 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:17:22 user nova-compute[72803]:       <mac address="fa:16:3e:1b:1a:49"/>
Aug 15 07:17:22 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:17:22 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:17:22 user nova-compute[72803]:       <target dev="tapca02489e-f3"/>
Aug 15 07:17:22 user nova-compute[72803]:     </interface>
Aug 15 07:17:22 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:17:22 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/console.log" append="off"/>
Aug 15 07:17:22 user nova-compute[72803]:     </serial>
Aug 15 07:17:22 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:17:22 user nova-compute[72803]:     <video>
Aug 15 07:17:22 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:17:22 user nova-compute[72803]:     </video>
Aug 15 07:17:22 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:17:22 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:17:22 user nova-compute[72803]:     </rng>
Aug 15 07:17:22 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:17:22 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:17:22 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:17:22 user nova-compute[72803]:     </memballoon>
Aug 15 07:17:22 user nova-compute[72803]:   </devices>
Aug 15 07:17:22 user nova-compute[72803]: </domain>
Aug 15 07:17:22 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-776555605',display_name='tempest-TestMinimumBasicScenario-server-776555605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-776555605',id=41,image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkG8deH+MspIOuSTtsx7S1v+ajnEtABiOWhmo6nYo6CQk5ilKRcV2ltjjvsnm6cm29/DmQyRETgiOoGbj5JLHScL/pb0/Q9tSENW0qlMy6o5W3IpjeOJplFowBjoQlvlw==',key_name='tempest-TestMinimumBasicScenario-1926102892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-8qtgi0gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:17:17Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=89e22ae0-9706-4295-9fdd-97a09b012328,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_vif [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca02489e-f3, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca02489e-f3, col_values=(('external_ids', {'iface-id': 'ca02489e-f336-4167-97a6-cf56edc6c64b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:1a:49', 'vm-uuid': '89e22ae0-9706-4295-9fdd-97a09b012328'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:22 user nova-compute[72803]: INFO os_vif [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3')
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No VIF found with MAC fa:16:3e:1b:1a:49, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIpyYuiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:17:22 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:17:22 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:17:22 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa1d2ad-4a34-4153-a9fc-4c63cc8ca587]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:17:22 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7abaec0-f2d8-432e-8003-fed370d0327f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c] added
Aug 15 07:17:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7968be1e-939d-4e8f-a0b4-4103955c6af3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a540b5cd-095a-4355-bb90-954af62c4703]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIpyYuiM {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIpyYuiM" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89542e7-90ea-447b-bdf1-bfe1c7149c71]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wIpyYuiM'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[55974c4f-5a44-45b7-88d2-e4c815962512]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bc4bae-a478-4e7f-8b91-3984f7225f1a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:17:22 user nova-compute[72803]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)
Aug 15 07:17:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:17:22 user nova-compute[72803]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)
Aug 15 07:17:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde9547a-aedc-4724-9c5a-58d179ad295f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c, portal: 172.16.0.220,3260]
Aug 15 07:17:22 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c, portal: 172.16.0.220,3260] successful.
Aug 15 07:17:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5abeb-7704-415c-be82-37eb3db1163b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c2f299-49a3-4101-9b7b-65bd01e7fa33]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:17:22 user nova-compute[72803]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)
Aug 15 07:17:22 user nova-compute[72803]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c (non-flash)
Aug 15 07:17:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:17:22 user nova-compute[72803]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)
Aug 15 07:17:22 user nova-compute[72803]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c (non-flash)
Aug 15 07:17:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[017e2a03-f990-4493-a296-fb031b13eda0]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:17:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIpyYuiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23931633062666331', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931633062666331', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'flavor' on Instance uuid 489f8bb1-12d2-4ba7-892a-b0906114b572 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:17:23 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:17:23 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:17:23 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:17:23 user nova-compute[72803]:   <serial>948b521f-45cd-444d-aae3-e2b4bbe0ed9c</serial>
Aug 15 07:17:23 user nova-compute[72803]: </disk>
Aug 15 07:17:23 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-b0e85136-b157-413e-8761-87b6114497ae req-e756fefc-68b8-4246-a6b8-33c6cc860b23 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b0e85136-b157-413e-8761-87b6114497ae req-e756fefc-68b8-4246-a6b8-33c6cc860b23 service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b0e85136-b157-413e-8761-87b6114497ae req-e756fefc-68b8-4246-a6b8-33c6cc860b23 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b0e85136-b157-413e-8761-87b6114497ae req-e756fefc-68b8-4246-a6b8-33c6cc860b23 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-b0e85136-b157-413e-8761-87b6114497ae req-e756fefc-68b8-4246-a6b8-33c6cc860b23 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:17:23 user nova-compute[72803]: WARNING nova.compute.manager [req-b0e85136-b157-413e-8761-87b6114497ae req-e756fefc-68b8-4246-a6b8-33c6cc860b23 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state building and task_state spawning.
Aug 15 07:17:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:17:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:17:24 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] No VIF found with MAC fa:16:3e:08:67:b9, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:17:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5aa5c677-365e-4411-9da3-5add492542e6 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.596s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-f50bc9d3-555f-4ede-b823-2fb41e3b6641 req-b193365f-5f6b-450e-9139-a3ce671e8600 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f50bc9d3-555f-4ede-b823-2fb41e3b6641 req-b193365f-5f6b-450e-9139-a3ce671e8600 service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f50bc9d3-555f-4ede-b823-2fb41e3b6641 req-b193365f-5f6b-450e-9139-a3ce671e8600 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f50bc9d3-555f-4ede-b823-2fb41e3b6641 req-b193365f-5f6b-450e-9139-a3ce671e8600 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-f50bc9d3-555f-4ede-b823-2fb41e3b6641 req-b193365f-5f6b-450e-9139-a3ce671e8600 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:17:26 user nova-compute[72803]: WARNING nova.compute.manager [req-f50bc9d3-555f-4ede-b823-2fb41e3b6641 req-b193365f-5f6b-450e-9139-a3ce671e8600 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state building and task_state spawning.
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083846.7521954, 89e22ae0-9706-4295-9fdd-97a09b012328 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:17:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] VM Resumed (Lifecycle Event)
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:17:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance spawned successfully.
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:17:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083846.7537386, 89e22ae0-9706-4295-9fdd-97a09b012328 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:17:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] VM Started (Lifecycle Event)
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:17:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:17:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Took 9.50 seconds to spawn the instance on the hypervisor.
Aug 15 07:17:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:17:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Took 10.23 seconds to build instance.
Aug 15 07:17:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3d3740e1-c599-4990-b3c9-7ac3eec4e20b tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.365s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:27 user nova-compute[72803]: INFO nova.compute.manager [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Detaching volume 948b521f-45cd-444d-aae3-e2b4bbe0ed9c
Aug 15 07:17:27 user nova-compute[72803]: INFO nova.virt.block_device [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Attempting to driver detach volume 948b521f-45cd-444d-aae3-e2b4bbe0ed9c from mountpoint /dev/vdb
Aug 15 07:17:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Attempting to detach device vdb from instance 489f8bb1-12d2-4ba7-892a-b0906114b572 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:17:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:17:27 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:17:27 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:17:27 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:17:27 user nova-compute[72803]:   <serial>948b521f-45cd-444d-aae3-e2b4bbe0ed9c</serial>
Aug 15 07:17:27 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:17:27 user nova-compute[72803]: </disk>
Aug 15 07:17:27 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:17:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Successfully detached device vdb from instance 489f8bb1-12d2-4ba7-892a-b0906114b572 from the persistent domain config.
Aug 15 07:17:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 489f8bb1-12d2-4ba7-892a-b0906114b572 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:17:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:17:27 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:17:27 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:17:27 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:17:27 user nova-compute[72803]:   <serial>948b521f-45cd-444d-aae3-e2b4bbe0ed9c</serial>
Aug 15 07:17:27 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:17:27 user nova-compute[72803]: </disk>
Aug 15 07:17:27 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:17:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692083847.9505885, 489f8bb1-12d2-4ba7-892a-b0906114b572 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:17:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 489f8bb1-12d2-4ba7-892a-b0906114b572 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:17:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Successfully detached device vdb from instance 489f8bb1-12d2-4ba7-892a-b0906114b572 from the live domain config.
Aug 15 07:17:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIpyYuiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:17:28 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d78f78-7fcf-4df8-ac7f-adc248137e5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83c89d-3457-4f1f-8968-63f3871dcae1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:17:28 user nova-compute[72803]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)
Aug 15 07:17:28 user nova-compute[72803]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c (non-flash)
Aug 15 07:17:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:17:28 user nova-compute[72803]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cec6ff-5890-4a72-9d11-1ac1924ed628 (non-flash)
Aug 15 07:17:28 user nova-compute[72803]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c (non-flash)
Aug 15 07:17:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e02db400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3562894-8e10-42fb-9fef-d9cc7236d44a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f287076-bdd6-4bf7-822a-f003efca0a49]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa7d2e-bf20-4a4b-a769-ada83ab2ef79]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4572f436-0464-4b56-9ff3-18c5d4136c92]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc996778-e752-4b37-a09b-545d599d9d76]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[be817584-923c-4adb-8f05-c452221ec7e8]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c, portal: 172.16.0.220,3260]
Aug 15 07:17:28 user nova-compute[72803]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c, portal: 172.16.0.220,3260] successful.
Aug 15 07:17:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:948b521f-45cd-444d-aae3-e2b4bbe0ed9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fb5ce2-b5f1-4a6d-89fa-d6b8598b3df2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] <== disconnect_volume: return (347ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:17:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:17:29 user nova-compute[72803]: DEBUG nova.objects.instance [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'flavor' on Instance uuid 489f8bb1-12d2-4ba7-892a-b0906114b572 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-58786574-c4f8-43df-96b4-bff751185508 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.079s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:40 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:42 user nova-compute[72803]: INFO nova.compute.manager [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Rescuing
Aug 15 07:17:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:17:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquired lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:17:42 user nova-compute[72803]: DEBUG nova.network.neutron [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:17:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:43 user nova-compute[72803]: DEBUG nova.network.neutron [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:17:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Releasing lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:17:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-e667e72a-6f1d-4263-adce-5fb450a438c9 req-fec623c1-6cb7-4608-af04-7a85731d78fa service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e667e72a-6f1d-4263-adce-5fb450a438c9 req-fec623c1-6cb7-4608-af04-7a85731d78fa service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e667e72a-6f1d-4263-adce-5fb450a438c9 req-fec623c1-6cb7-4608-af04-7a85731d78fa service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e667e72a-6f1d-4263-adce-5fb450a438c9 req-fec623c1-6cb7-4608-af04-7a85731d78fa service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.compute.manager [req-e667e72a-6f1d-4263-adce-5fb450a438c9 req-fec623c1-6cb7-4608-af04-7a85731d78fa service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:17:44 user nova-compute[72803]: WARNING nova.compute.manager [req-e667e72a-6f1d-4263-adce-5fb450a438c9 req-fec623c1-6cb7-4608-af04-7a85731d78fa service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state active and task_state rescuing.
Aug 15 07:17:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance destroyed successfully.
Aug 15 07:17:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Attempting rescue
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72803) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance directory exists: not creating {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 07:17:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Creating image(s)
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'trusted_certs' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue" returned: 0 in 0.054s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'migration_context' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Start _get_guest_xml network_info=[{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:56:c4:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'resources' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'numa_topology' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:44 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:17:44 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-622417303',display_name='tempest-ServerRescueNegativeTestJSON-server-622417303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-622417303',id=35,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:13:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-rhfwcjxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:13:05Z,user_data=None,user_id='0cf4a499a9d54262bd8959b87918717c',uuid=39617700-3648-4f38-b129-0c71584828c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:56:c4:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:56:c4:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e86640-e2') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.objects.instance [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'pci_devices' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:17:44 user nova-compute[72803]:   <uuid>39617700-3648-4f38-b129-0c71584828c9</uuid>
Aug 15 07:17:44 user nova-compute[72803]:   <name>instance-00000023</name>
Aug 15 07:17:44 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:17:44 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:17:44 user nova-compute[72803]:   <metadata>
Aug 15 07:17:44 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:17:44 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:17:44 user nova-compute[72803]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-622417303</nova:name>
Aug 15 07:17:44 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:17:44</nova:creationTime>
Aug 15 07:17:44 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:17:44 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:17:44 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:17:44 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:17:44 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:17:44 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:17:44 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:17:44 user nova-compute[72803]:       <nova:owner>
Aug 15 07:17:44 user nova-compute[72803]:         <nova:user uuid="0cf4a499a9d54262bd8959b87918717c">tempest-ServerRescueNegativeTestJSON-1974019782-project-member</nova:user>
Aug 15 07:17:44 user nova-compute[72803]:         <nova:project uuid="eaa8ac0862d14e7792d6c03f46c170ba">tempest-ServerRescueNegativeTestJSON-1974019782</nova:project>
Aug 15 07:17:44 user nova-compute[72803]:       </nova:owner>
Aug 15 07:17:44 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:17:44 user nova-compute[72803]:       <nova:ports>
Aug 15 07:17:44 user nova-compute[72803]:         <nova:port uuid="98e86640-e22c-4601-a1d7-6ed0ddf79cd2">
Aug 15 07:17:44 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 07:17:44 user nova-compute[72803]:         </nova:port>
Aug 15 07:17:44 user nova-compute[72803]:       </nova:ports>
Aug 15 07:17:44 user nova-compute[72803]:     </nova:instance>
Aug 15 07:17:44 user nova-compute[72803]:   </metadata>
Aug 15 07:17:44 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:17:44 user nova-compute[72803]:     <system>
Aug 15 07:17:44 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:17:44 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:17:44 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:17:44 user nova-compute[72803]:       <entry name="serial">39617700-3648-4f38-b129-0c71584828c9</entry>
Aug 15 07:17:44 user nova-compute[72803]:       <entry name="uuid">39617700-3648-4f38-b129-0c71584828c9</entry>
Aug 15 07:17:44 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:17:44 user nova-compute[72803]:     </system>
Aug 15 07:17:44 user nova-compute[72803]:   </sysinfo>
Aug 15 07:17:44 user nova-compute[72803]:   <os>
Aug 15 07:17:44 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:17:44 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:17:44 user nova-compute[72803]:   </os>
Aug 15 07:17:44 user nova-compute[72803]:   <features>
Aug 15 07:17:44 user nova-compute[72803]:     <acpi/>
Aug 15 07:17:44 user nova-compute[72803]:     <apic/>
Aug 15 07:17:44 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:17:44 user nova-compute[72803]:   </features>
Aug 15 07:17:44 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:17:44 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:17:44 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:17:44 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:17:44 user nova-compute[72803]:   </clock>
Aug 15 07:17:44 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:17:44 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:17:44 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:17:44 user nova-compute[72803]:   </cpu>
Aug 15 07:17:44 user nova-compute[72803]:   <devices>
Aug 15 07:17:44 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:17:44 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:17:44 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue"/>
Aug 15 07:17:44 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:17:44 user nova-compute[72803]:     </disk>
Aug 15 07:17:44 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:17:44 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:17:44 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk"/>
Aug 15 07:17:44 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:17:44 user nova-compute[72803]:     </disk>
Aug 15 07:17:44 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:17:44 user nova-compute[72803]:       <mac address="fa:16:3e:56:c4:5a"/>
Aug 15 07:17:44 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:17:44 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:17:44 user nova-compute[72803]:       <target dev="tap98e86640-e2"/>
Aug 15 07:17:44 user nova-compute[72803]:     </interface>
Aug 15 07:17:44 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:17:44 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/console.log" append="off"/>
Aug 15 07:17:44 user nova-compute[72803]:     </serial>
Aug 15 07:17:44 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:17:44 user nova-compute[72803]:     <video>
Aug 15 07:17:44 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:17:44 user nova-compute[72803]:     </video>
Aug 15 07:17:44 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:17:44 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:17:44 user nova-compute[72803]:     </rng>
Aug 15 07:17:44 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:17:44 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:17:44 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:17:44 user nova-compute[72803]:     </memballoon>
Aug 15 07:17:44 user nova-compute[72803]:   </devices>
Aug 15 07:17:44 user nova-compute[72803]: </domain>
Aug 15 07:17:44 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:17:44 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance destroyed successfully.
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:17:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No VIF found with MAC fa:16:3e:56:c4:5a, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-8e2cd0ba-fadf-4822-99c0-7ea7878f8ef6 req-28ff9989-c887-47ca-90cc-70ad1d76e48d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8e2cd0ba-fadf-4822-99c0-7ea7878f8ef6 req-28ff9989-c887-47ca-90cc-70ad1d76e48d service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8e2cd0ba-fadf-4822-99c0-7ea7878f8ef6 req-28ff9989-c887-47ca-90cc-70ad1d76e48d service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8e2cd0ba-fadf-4822-99c0-7ea7878f8ef6 req-28ff9989-c887-47ca-90cc-70ad1d76e48d service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG nova.compute.manager [req-8e2cd0ba-fadf-4822-99c0-7ea7878f8ef6 req-28ff9989-c887-47ca-90cc-70ad1d76e48d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:17:46 user nova-compute[72803]: WARNING nova.compute.manager [req-8e2cd0ba-fadf-4822-99c0-7ea7878f8ef6 req-28ff9989-c887-47ca-90cc-70ad1d76e48d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state active and task_state rescuing.
Aug 15 07:17:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:47 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:47 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 39617700-3648-4f38-b129-0c71584828c9 due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083868.3551757, 39617700-3648-4f38-b129-0c71584828c9 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:17:48 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] VM Resumed (Lifecycle Event)
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-35863017-0e8b-4dfa-8b57-d829323b496d tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:17:48 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083868.3589165, 39617700-3648-4f38-b129-0c71584828c9 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:17:48 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] VM Started (Lifecycle Event)
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:17:48 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:17:48 user nova-compute[72803]: WARNING nova.compute.manager [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state rescued and task_state None.
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:17:48 user nova-compute[72803]: WARNING nova.compute.manager [req-7af6ddea-e801-4540-b248-f225f54918a8 req-8ed3dea8-c261-423b-adf2-f440efd357cf service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state rescued and task_state None.
Aug 15 07:17:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:50 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:50 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:17:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:51 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:54 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:17:54 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7913MB free_disk=25.18144989013672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 489f8bb1-12d2-4ba7-892a-b0906114b572 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f9b55b06-8a65-4202-b494-f4261c872f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 632fdd77-c7d3-493b-b8b2-e1a16296fdaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 89e22ae0-9706-4295-9fdd-97a09b012328 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:17:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:17:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:55 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:17:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:17:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:17:55 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:17:56 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updating instance_info_cache with network_info: [{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:17:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:17:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:17:56 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:17:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-295c3a95-f83c-4e67-860d-d7947b55598c req-d8fd794d-45c3-4155-af50-60586590716c service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-changed-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-295c3a95-f83c-4e67-860d-d7947b55598c req-d8fd794d-45c3-4155-af50-60586590716c service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Refreshing instance network info cache due to event network-changed-f2cc6417-2234-4954-b1a8-d51f14da390f. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:17:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-295c3a95-f83c-4e67-860d-d7947b55598c req-d8fd794d-45c3-4155-af50-60586590716c service nova] Acquiring lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:17:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-295c3a95-f83c-4e67-860d-d7947b55598c req-d8fd794d-45c3-4155-af50-60586590716c service nova] Acquired lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:17:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-295c3a95-f83c-4e67-860d-d7947b55598c req-d8fd794d-45c3-4155-af50-60586590716c service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Refreshing network info cache for port f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:17:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-295c3a95-f83c-4e67-860d-d7947b55598c req-d8fd794d-45c3-4155-af50-60586590716c service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updated VIF entry in instance network info cache for port f2cc6417-2234-4954-b1a8-d51f14da390f. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:17:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-295c3a95-f83c-4e67-860d-d7947b55598c req-d8fd794d-45c3-4155-af50-60586590716c service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:17:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-295c3a95-f83c-4e67-860d-d7947b55598c req-d8fd794d-45c3-4155-af50-60586590716c service nova] Releasing lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:17:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:17:59 user nova-compute[72803]: INFO nova.compute.manager [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] instance snapshotting
Aug 15 07:17:59 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Beginning live snapshot process
Aug 15 07:17:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json -f qcow2 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:17:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:17:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json -f qcow2 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:17:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-7a5970b1-cbfe-4761-82dc-1b4076217d15 req-8479ccad-b960-4468-a7d0-d56bd4c472e2 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-changed-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:17:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-7a5970b1-cbfe-4761-82dc-1b4076217d15 req-8479ccad-b960-4468-a7d0-d56bd4c472e2 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Refreshing instance network info cache due to event network-changed-19186478-2d79-4d93-9af5-bca0fdea4c79. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:17:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7a5970b1-cbfe-4761-82dc-1b4076217d15 req-8479ccad-b960-4468-a7d0-d56bd4c472e2 service nova] Acquiring lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:17:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7a5970b1-cbfe-4761-82dc-1b4076217d15 req-8479ccad-b960-4468-a7d0-d56bd4c472e2 service nova] Acquired lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:17:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-7a5970b1-cbfe-4761-82dc-1b4076217d15 req-8479ccad-b960-4468-a7d0-d56bd4c472e2 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Refreshing network info cache for port 19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:18:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8ltw_6gj/9e579f340dac4af1a202ec0ad436457d.delta 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8ltw_6gj/9e579f340dac4af1a202ec0ad436457d.delta 1073741824" returned: 0 in 0.056s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 07:18:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-7a5970b1-cbfe-4761-82dc-1b4076217d15 req-8479ccad-b960-4468-a7d0-d56bd4c472e2 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updated VIF entry in instance network info cache for port 19186478-2d79-4d93-9af5-bca0fdea4c79. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:18:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-7a5970b1-cbfe-4761-82dc-1b4076217d15 req-8479ccad-b960-4468-a7d0-d56bd4c472e2 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updating instance_info_cache with network_info: [{"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:18:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7a5970b1-cbfe-4761-82dc-1b4076217d15 req-8479ccad-b960-4468-a7d0-d56bd4c472e2 service nova] Releasing lock "refresh_cache-632fdd77-c7d3-493b-b8b2-e1a16296fdaa" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:18:01 user nova-compute[72803]: INFO nova.compute.manager [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Rebuilding instance
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lazy-loading 'trusted_certs' on Instance uuid 632fdd77-c7d3-493b-b8b2-e1a16296fdaa {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lazy-loading 'pci_requests' on Instance uuid 632fdd77-c7d3-493b-b8b2-e1a16296fdaa {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lazy-loading 'pci_devices' on Instance uuid 632fdd77-c7d3-493b-b8b2-e1a16296fdaa {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lazy-loading 'resources' on Instance uuid 632fdd77-c7d3-493b-b8b2-e1a16296fdaa {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lazy-loading 'migration_context' on Instance uuid 632fdd77-c7d3-493b-b8b2-e1a16296fdaa {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72803) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72803) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 07:18:01 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8ltw_6gj/9e579f340dac4af1a202ec0ad436457d.delta /opt/stack/data/nova/instances/snapshots/tmp8ltw_6gj/9e579f340dac4af1a202ec0ad436457d {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-3c83dec2-61be-40ca-b894-8e625c8d3a70 req-7a2b9aca-9756-4380-817b-7f76779f8669 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-unplugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c83dec2-61be-40ca-b894-8e625c8d3a70 req-7a2b9aca-9756-4380-817b-7f76779f8669 service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c83dec2-61be-40ca-b894-8e625c8d3a70 req-7a2b9aca-9756-4380-817b-7f76779f8669 service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c83dec2-61be-40ca-b894-8e625c8d3a70 req-7a2b9aca-9756-4380-817b-7f76779f8669 service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-3c83dec2-61be-40ca-b894-8e625c8d3a70 req-7a2b9aca-9756-4380-817b-7f76779f8669 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] No waiting events found dispatching network-vif-unplugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:18:01 user nova-compute[72803]: WARNING nova.compute.manager [req-3c83dec2-61be-40ca-b894-8e625c8d3a70 req-7a2b9aca-9756-4380-817b-7f76779f8669 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received unexpected event network-vif-unplugged-19186478-2d79-4d93-9af5-bca0fdea4c79 for instance with vm_state active and task_state rebuilding.
Aug 15 07:18:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance destroyed successfully.
Aug 15 07:18:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance destroyed successfully.
Aug 15 07:18:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2127844397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-304935621',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9k45/rjpORVh8DYFQ+KcXU5YHBpSbUhTXZlH0Hus32rGVDK580Ryh6t9TFdKiNSDa8Bo8DYL8/TgERDhP7eJUf/qR3DM5r75WovgrSvzC2twKY3xRO2iXmBFEalcyFmQ==',key_name='tempest-keypair-637292857',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:16:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3206b2e9c924b49becaa2ff5b4115e4',ramdisk_id='',reservation_id='r-im66e1d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1796571112',owner_user_name='tempest-ServerActionsV293TestJSON-1796571112-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d7a7a87dbd1449fb70b8851cf543e42',uuid=632fdd77-c7d3-493b-b8b2-e1a16296fdaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converting VIF {"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_vif [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19186478-2d, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:18:02 user nova-compute[72803]: INFO os_vif [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d')
Aug 15 07:18:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:18:02 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ae083-b51b-43fb-ad58-aa2845fb165f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a00479e-18d7-415b-be12-3ec571c535c2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:18:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:18:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05f0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[581b2066-7160-4329-9b04-57c7cf4d5db9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.035s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8ltw_6gj/9e579f340dac4af1a202ec0ad436457d.delta /opt/stack/data/nova/instances/snapshots/tmp8ltw_6gj/9e579f340dac4af1a202ec0ad436457d" returned: 0 in 0.578s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d26b558-dcce-4060-a7c8-8de8d15a0154]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Snapshot extracted, beginning image upload
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[943359a3-89f7-48cc-b404-aa3f48f22a85]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8164e48d-2b81-44a7-ad07-4267eeb88553]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO935bcdcf-2316972205467908', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_935bcdcf', '/dev/disk/by-id/scsi-23233313639373232') {{(pid=84151) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee916c2-2a56-496d-85a2-bf4ae31ebf5e]: (4, None) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d1da6d-ed6b-4030-b187-855292f9200e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2301afc8-5208-45f9-966e-ae6f1ccf4964]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260]
Aug 15 07:18:02 user nova-compute[72803]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260] successful.
Aug 15 07:18:02 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[56367d63-0dc7-49bb-aeef-2107f00ffa99]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] <== disconnect_volume: return (349ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:18:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Deleting instance files /opt/stack/data/nova/instances/632fdd77-c7d3-493b-b8b2-e1a16296fdaa_del
Aug 15 07:18:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Deletion of /opt/stack/data/nova/instances/632fdd77-c7d3-493b-b8b2-e1a16296fdaa_del complete
Aug 15 07:18:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 632fdd77-c7d3-493b-b8b2-e1a16296fdaa could not be found.
Aug 15 07:18:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:18:02 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e199138-fd4a-40d0-9878-9fc315ea4ab2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 15 07:18:02 user nova-compute[72803]: : NotImplementedError
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d0055-32a1-4137-ab5e-d8f7a602fe9e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:18:02 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:18:02 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:18:02 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 07:18:02 user nova-compute[72803]: : NotImplementedError
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e05f0040>, {}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Disconnecting from: [] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] <== disconnect_volume: return (56ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:18:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Preparing to wait for external event volume-reimaged-84e9ec09-cb51-4a19-aff9-6712b7491d87 {{(pid=72803) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-dc9471c3-8d11-4b23-9cbb-3420ea180909 req-d54d663b-d3d7-4cdb-a076-ec59d5057e9d service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-dc9471c3-8d11-4b23-9cbb-3420ea180909 req-d54d663b-d3d7-4cdb-a076-ec59d5057e9d service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-dc9471c3-8d11-4b23-9cbb-3420ea180909 req-d54d663b-d3d7-4cdb-a076-ec59d5057e9d service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-dc9471c3-8d11-4b23-9cbb-3420ea180909 req-d54d663b-d3d7-4cdb-a076-ec59d5057e9d service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-dc9471c3-8d11-4b23-9cbb-3420ea180909 req-d54d663b-d3d7-4cdb-a076-ec59d5057e9d service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] No event matching network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 in dict_keys([('volume-reimaged', '84e9ec09-cb51-4a19-aff9-6712b7491d87')]) {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 15 07:18:03 user nova-compute[72803]: WARNING nova.compute.manager [req-dc9471c3-8d11-4b23-9cbb-3420ea180909 req-d54d663b-d3d7-4cdb-a076-ec59d5057e9d service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received unexpected event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 for instance with vm_state active and task_state rebuilding.
Aug 15 07:18:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Snapshot image upload complete
Aug 15 07:18:04 user nova-compute[72803]: INFO nova.compute.manager [None req-471a889d-7909-4273-9825-1c094e6aa560 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Took 5.64 seconds to snapshot the instance on the hypervisor.
Aug 15 07:18:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "8f124c37-5cce-4021-bd16-bd01e676d19b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:18:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:13 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:18:13 user nova-compute[72803]: INFO nova.compute.claims [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Claim successful on node user
Aug 15 07:18:14 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:18:14 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:18:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:18:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:18:14 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:18:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:18:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:18:14 user nova-compute[72803]: INFO nova.virt.block_device [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Booting with volume snapshot c0b0409c-0d34-40f4-bf55-0bd402e478d3 at /dev/vda
Aug 15 07:18:14 user nova-compute[72803]: DEBUG nova.policy [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '962292c4846b4ceab2cb00867135e136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9714fffd91c94d79aaa288d93fdfaffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:18:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:15 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Successfully created port: 3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Successfully updated port: 3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "refresh_cache-8f124c37-5cce-4021-bd16-bd01e676d19b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquired lock "refresh_cache-8f124c37-5cce-4021-bd16-bd01e676d19b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.compute.manager [req-7ce5fa3c-ec25-4e9d-befa-a5b72dbc992d req-1770bf10-1908-401c-9f3b-5f41fbc7aa2a service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received event network-changed-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.compute.manager [req-7ce5fa3c-ec25-4e9d-befa-a5b72dbc992d req-1770bf10-1908-401c-9f3b-5f41fbc7aa2a service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Refreshing instance network info cache due to event network-changed-3f3146f8-bed2-4df2-9fda-31840234ca18. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7ce5fa3c-ec25-4e9d-befa-a5b72dbc992d req-1770bf10-1908-401c-9f3b-5f41fbc7aa2a service nova] Acquiring lock "refresh_cache-8f124c37-5cce-4021-bd16-bd01e676d19b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Updating instance_info_cache with network_info: [{"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Releasing lock "refresh_cache-8f124c37-5cce-4021-bd16-bd01e676d19b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Instance network_info: |[{"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7ce5fa3c-ec25-4e9d-befa-a5b72dbc992d req-1770bf10-1908-401c-9f3b-5f41fbc7aa2a service nova] Acquired lock "refresh_cache-8f124c37-5cce-4021-bd16-bd01e676d19b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.network.neutron [req-7ce5fa3c-ec25-4e9d-befa-a5b72dbc992d req-1770bf10-1908-401c-9f3b-5f41fbc7aa2a service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Refreshing network info cache for port 3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.network.neutron [req-7ce5fa3c-ec25-4e9d-befa-a5b72dbc992d req-1770bf10-1908-401c-9f3b-5f41fbc7aa2a service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Updated VIF entry in instance network info cache for port 3f3146f8-bed2-4df2-9fda-31840234ca18. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG nova.network.neutron [req-7ce5fa3c-ec25-4e9d-befa-a5b72dbc992d req-1770bf10-1908-401c-9f3b-5f41fbc7aa2a service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Updating instance_info_cache with network_info: [{"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:18:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7ce5fa3c-ec25-4e9d-befa-a5b72dbc992d req-1770bf10-1908-401c-9f3b-5f41fbc7aa2a service nova] Releasing lock "refresh_cache-8f124c37-5cce-4021-bd16-bd01e676d19b" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:18:17 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083882.1081786, 632fdd77-c7d3-493b-b8b2-e1a16296fdaa => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:18:17 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] VM Stopped (Lifecycle Event)
Aug 15 07:18:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-362fb64c-7102-4995-9bcf-b8684d2a0acf None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:18 user nova-compute[72803]: INFO nova.compute.manager [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Terminating instance
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-898208af-cb37-4871-9d4f-217435763720 req-87dc5bfc-de38-4477-8f4a-69b159f88fbc service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-changed-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-898208af-cb37-4871-9d4f-217435763720 req-87dc5bfc-de38-4477-8f4a-69b159f88fbc service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Refreshing instance network info cache due to event network-changed-11b0649b-f346-475d-9d6e-c89efcc4418d. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-898208af-cb37-4871-9d4f-217435763720 req-87dc5bfc-de38-4477-8f4a-69b159f88fbc service nova] Acquiring lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-898208af-cb37-4871-9d4f-217435763720 req-87dc5bfc-de38-4477-8f4a-69b159f88fbc service nova] Acquired lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.network.neutron [req-898208af-cb37-4871-9d4f-217435763720 req-87dc5bfc-de38-4477-8f4a-69b159f88fbc service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Refreshing network info cache for port 11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-9e339000-efa0-4400-92f8-a237fcb74423 req-38967317-323c-47a1-9e02-72198b7aa495 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-vif-unplugged-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9e339000-efa0-4400-92f8-a237fcb74423 req-38967317-323c-47a1-9e02-72198b7aa495 service nova] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9e339000-efa0-4400-92f8-a237fcb74423 req-38967317-323c-47a1-9e02-72198b7aa495 service nova] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9e339000-efa0-4400-92f8-a237fcb74423 req-38967317-323c-47a1-9e02-72198b7aa495 service nova] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-9e339000-efa0-4400-92f8-a237fcb74423 req-38967317-323c-47a1-9e02-72198b7aa495 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] No waiting events found dispatching network-vif-unplugged-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-9e339000-efa0-4400-92f8-a237fcb74423 req-38967317-323c-47a1-9e02-72198b7aa495 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-vif-unplugged-11b0649b-f346-475d-9d6e-c89efcc4418d for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.network.neutron [req-898208af-cb37-4871-9d4f-217435763720 req-87dc5bfc-de38-4477-8f4a-69b159f88fbc service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updated VIF entry in instance network info cache for port 11b0649b-f346-475d-9d6e-c89efcc4418d. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.network.neutron [req-898208af-cb37-4871-9d4f-217435763720 req-87dc5bfc-de38-4477-8f4a-69b159f88fbc service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updating instance_info_cache with network_info: [{"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-898208af-cb37-4871-9d4f-217435763720 req-87dc5bfc-de38-4477-8f4a-69b159f88fbc service nova] Releasing lock "refresh_cache-489f8bb1-12d2-4ba7-892a-b0906114b572" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:18:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Instance destroyed successfully.
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.objects.instance [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'resources' on Instance uuid 489f8bb1-12d2-4ba7-892a-b0906114b572 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2035112338',display_name='tempest-TestStampPattern-server-2035112338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2035112338',id=38,image_ref='536f4974-b4c1-4128-b487-bdc42061f503',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYEdS660yr6zgAKFBXVbvLxAfpYjVGFPDW51c3q4Ydsz8Eye3gBE8udzyAe91FO7kCB6FzhaCGWoXBMPYW0RCVxd9Mg8nCu2yJHA/4Si/grKlEE/CLjLGwDhuMUdNTz9w==',key_name='tempest-TestStampPattern-1230572878',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb2074606144e48a856a092c7e32781',ramdisk_id='',reservation_id='r-jdjdwloo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8d0be6c9-8e93-4a50-bf2b-d287e619b303',image_min_disk='1',image_min_ram='0',image_owner_id='adb2074606144e48a856a092c7e32781',image_owner_project_name='tempest-TestStampPattern-1675165439',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1675165439-project-member',image_user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',owner_project_name='tempest-TestStampPattern-1675165439',owner_user_name='tempest-TestStampPattern-1675165439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:15:26Z,user_data=None,user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',uuid=489f8bb1-12d2-4ba7-892a-b0906114b572,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converting VIF {"id": "11b0649b-f346-475d-9d6e-c89efcc4418d", "address": "fa:16:3e:08:67:b9", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b0649b-f3", "ovs_interfaceid": "11b0649b-f346-475d-9d6e-c89efcc4418d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=11b0649b-f346-475d-9d6e-c89efcc4418d,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b0649b-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG os_vif [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=11b0649b-f346-475d-9d6e-c89efcc4418d,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b0649b-f3') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11b0649b-f3, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:18:18 user nova-compute[72803]: INFO os_vif [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:67:b9,bridge_name='br-int',has_traffic_filtering=True,id=11b0649b-f346-475d-9d6e-c89efcc4418d,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b0649b-f3')
Aug 15 07:18:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Deleting instance files /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572_del
Aug 15 07:18:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Deletion of /opt/stack/data/nova/instances/489f8bb1-12d2-4ba7-892a-b0906114b572_del complete
Aug 15 07:18:18 user nova-compute[72803]: INFO nova.compute.manager [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 07:18:18 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:18:18 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:18:19 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:18:19 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Took 0.55 seconds to deallocate network for instance.
Aug 15 07:18:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:19 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:18:19 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:18:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:19 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Deleted allocations for instance 489f8bb1-12d2-4ba7-892a-b0906114b572
Aug 15 07:18:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da0fbe41-71fb-4613-a13f-4be50a50ea60 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG os_brick.utils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-0b6acb59-73e1-469c-8289-2a2449d68c15 req-e71b9f10-52ed-4858-9176-fe604dfe3a61 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-vif-deleted-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c777b-6f9b-4465-9e48-6f7de72c4204]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[26729474-0ef5-46d1-975b-36ec2d6a6cc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2774d3-39a3-4339-8b74-69cc1ec9f086]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a087234-3085-489d-85f8-8b0d1c754931]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-13163664-c70d-47f0-ba06-cc3eac535a85 req-5e8765d3-83ab-4475-b981-764815f5bf64 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received event network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-13163664-c70d-47f0-ba06-cc3eac535a85 req-5e8765d3-83ab-4475-b981-764815f5bf64 service nova] Acquiring lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-13163664-c70d-47f0-ba06-cc3eac535a85 req-5e8765d3-83ab-4475-b981-764815f5bf64 service nova] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-13163664-c70d-47f0-ba06-cc3eac535a85 req-5e8765d3-83ab-4475-b981-764815f5bf64 service nova] Lock "489f8bb1-12d2-4ba7-892a-b0906114b572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-13163664-c70d-47f0-ba06-cc3eac535a85 req-5e8765d3-83ab-4475-b981-764815f5bf64 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] No waiting events found dispatching network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:18:20 user nova-compute[72803]: WARNING nova.compute.manager [req-13163664-c70d-47f0-ba06-cc3eac535a85 req-5e8765d3-83ab-4475-b981-764815f5bf64 service nova] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Received unexpected event network-vif-plugged-11b0649b-f346-475d-9d6e-c89efcc4418d for instance with vm_state deleted and task_state None.
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:18:20 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:18:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619c5b5-500f-4158-9c70-b4060e0d2973]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG os_brick.utils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:18:20 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Updating existing volume attachment record: a838caa8-877a-4495-bdb9-6df8e5bef18b {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 req-eb8d5f43-4263-43a0-94ac-687b86d3f0da service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event volume-reimaged-84e9ec09-cb51-4a19-aff9-6712b7491d87 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 req-eb8d5f43-4263-43a0-94ac-687b86d3f0da service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 req-eb8d5f43-4263-43a0-94ac-687b86d3f0da service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 req-eb8d5f43-4263-43a0-94ac-687b86d3f0da service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 req-eb8d5f43-4263-43a0-94ac-687b86d3f0da service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Processing event volume-reimaged-84e9ec09-cb51-4a19-aff9-6712b7491d87 {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:18:21 user nova-compute[72803]: INFO nova.virt.block_device [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Booting with volume 84e9ec09-cb51-4a19-aff9-6712b7491d87 at /dev/vda
Aug 15 07:18:21 user nova-compute[72803]: DEBUG os_brick.utils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaa562e-efb9-44c9-a8c6-a582833d56a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa51e10-a893-4b1c-a4de-33245730008d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7089e517-b1f1-421d-9fe1-6796d85185e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5702d0f2-6372-434f-94c6-3da0f0c6dac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:18:21 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:18:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce17dfe-f405-4a50-a28f-88240ddf2137]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG os_brick.utils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:18:21 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updating existing volume attachment record: ca80d62d-fc2d-4e3d-ac27-2db6734e6e3b {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:18:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:18:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Creating image(s)
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Ensure instance console log exists: /opt/stack/data/nova/instances/8f124c37-5cce-4021-bd16-bd01e676d19b/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Start _get_guest_xml network_info=[{"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'a838caa8-877a-4495-bdb9-6df8e5bef18b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsjXEfZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f124c37-5cce-4021-bd16-bd01e676d19b', 'attached_at': '', 'detached_at': '', 'volume_id': 'e70262c9-04cc-4d61-bfc8-02454bf3f306', 'serial': 'e70262c9-04cc-4d61-bfc8-02454bf3f306'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:18:29 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:18:29 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsjXEfZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:18:29 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:18:29 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:18:29 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd8e6ad-8265-4037-a9e2-043b870c668a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:18:29 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fa117b-b8fb-4146-a41a-78bddcf6a9f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306] added
Aug 15 07:18:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.105s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ec2d9f-cca9-40e9-8a4f-2d3c368e49ca]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67268d7-8f80-47bd-af35-75e6a4617120]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsjXEfZS {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsjXEfZS" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37aced7-c306-4fe1-ac12-c83d83a52449]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QsjXEfZS'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d4253-fbba-4b45-bb2a-0ad749b9c6cd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76a5953-6d01-4eb9-a6c1-54528c1930d7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:18:29 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:18:29 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:18:29 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 07:18:29 user nova-compute[72803]: 
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee139d5-1f2f-4f27-b292-202326a1a620]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306, portal: 172.16.0.220,3260]
Aug 15 07:18:29 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306, portal: 172.16.0.220,3260] successful.
Aug 15 07:18:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[440825c3-cb46-402e-b5b0-3345bf5fdb48]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5598ae0-361e-4d9c-b588-6bcd801afe66]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:18:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:18:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[022ae8d4-5dfa-47e4-979d-60f383a4848c]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsjXEfZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:18:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:18:30 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Creating image(s)
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Ensure instance console log exists: /opt/stack/data/nova/instances/632fdd77-c7d3-493b-b8b2-e1a16296fdaa/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Start _get_guest_xml network_info=[{"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'ca80d62d-fc2d-4e3d-ac27-2db6734e6e3b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '632fdd77-c7d3-493b-b8b2-e1a16296fdaa', 'attached_at': '', 'detached_at': '', 'volume_id': '84e9ec09-cb51-4a19-aff9-6712b7491d87', 'serial': '84e9ec09-cb51-4a19-aff9-6712b7491d87'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:18:30 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 07:18:30 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lazy-loading 'vcpu_model' on Instance uuid 632fdd77-c7d3-493b-b8b2-e1a16296fdaa {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:18:30 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26639313837356133', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639313837356133', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:18:30 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:18:30 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bcbbe8-9cd8-4279-aaf5-dd173528e91b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:18:30 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1154081862',display_name='tempest-TestVolumeBootPattern-server-1154081862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1154081862',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-tfli6ljf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:18:14Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=8f124c37-5cce-4021-bd16-bd01e676d19b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=3f3146f8-bed2-4df2-9fda-31840234ca18,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3146f8-be') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f124c37-5cce-4021-bd16-bd01e676d19b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:18:30 user nova-compute[72803]:   <uuid>8f124c37-5cce-4021-bd16-bd01e676d19b</uuid>
Aug 15 07:18:30 user nova-compute[72803]:   <name>instance-0000002a</name>
Aug 15 07:18:30 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:18:30 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:18:30 user nova-compute[72803]:   <metadata>
Aug 15 07:18:30 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:18:30 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:18:30 user nova-compute[72803]:       <nova:name>tempest-TestVolumeBootPattern-server-1154081862</nova:name>
Aug 15 07:18:30 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:18:29</nova:creationTime>
Aug 15 07:18:30 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:18:30 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:18:30 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:18:30 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:18:30 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:18:30 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:18:30 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:18:30 user nova-compute[72803]:       <nova:owner>
Aug 15 07:18:30 user nova-compute[72803]:         <nova:user uuid="962292c4846b4ceab2cb00867135e136">tempest-TestVolumeBootPattern-940544162-project-member</nova:user>
Aug 15 07:18:30 user nova-compute[72803]:         <nova:project uuid="9714fffd91c94d79aaa288d93fdfaffa">tempest-TestVolumeBootPattern-940544162</nova:project>
Aug 15 07:18:30 user nova-compute[72803]:       </nova:owner>
Aug 15 07:18:30 user nova-compute[72803]:       <nova:ports>
Aug 15 07:18:30 user nova-compute[72803]:         <nova:port uuid="3f3146f8-bed2-4df2-9fda-31840234ca18">
Aug 15 07:18:30 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 07:18:30 user nova-compute[72803]:         </nova:port>
Aug 15 07:18:30 user nova-compute[72803]:       </nova:ports>
Aug 15 07:18:30 user nova-compute[72803]:     </nova:instance>
Aug 15 07:18:30 user nova-compute[72803]:   </metadata>
Aug 15 07:18:30 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:18:30 user nova-compute[72803]:     <system>
Aug 15 07:18:30 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:18:30 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:18:30 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:18:30 user nova-compute[72803]:       <entry name="serial">8f124c37-5cce-4021-bd16-bd01e676d19b</entry>
Aug 15 07:18:30 user nova-compute[72803]:       <entry name="uuid">8f124c37-5cce-4021-bd16-bd01e676d19b</entry>
Aug 15 07:18:30 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:18:30 user nova-compute[72803]:     </system>
Aug 15 07:18:30 user nova-compute[72803]:   </sysinfo>
Aug 15 07:18:30 user nova-compute[72803]:   <os>
Aug 15 07:18:30 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:18:30 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:18:30 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:18:30 user nova-compute[72803]:   </os>
Aug 15 07:18:30 user nova-compute[72803]:   <features>
Aug 15 07:18:30 user nova-compute[72803]:     <acpi/>
Aug 15 07:18:30 user nova-compute[72803]:     <apic/>
Aug 15 07:18:30 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:18:30 user nova-compute[72803]:   </features>
Aug 15 07:18:30 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:18:30 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:18:30 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:18:30 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:18:30 user nova-compute[72803]:   </clock>
Aug 15 07:18:30 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:18:30 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:18:30 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:18:30 user nova-compute[72803]:   </cpu>
Aug 15 07:18:30 user nova-compute[72803]:   <devices>
Aug 15 07:18:30 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:18:30 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:18:30 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 07:18:30 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:18:30 user nova-compute[72803]:       <serial>e70262c9-04cc-4d61-bfc8-02454bf3f306</serial>
Aug 15 07:18:30 user nova-compute[72803]:     </disk>
Aug 15 07:18:30 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:18:30 user nova-compute[72803]:       <mac address="fa:16:3e:a2:a2:9f"/>
Aug 15 07:18:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:18:30 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:18:30 user nova-compute[72803]:       <target dev="tap3f3146f8-be"/>
Aug 15 07:18:30 user nova-compute[72803]:     </interface>
Aug 15 07:18:30 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:18:30 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/8f124c37-5cce-4021-bd16-bd01e676d19b/console.log" append="off"/>
Aug 15 07:18:30 user nova-compute[72803]:     </serial>
Aug 15 07:18:30 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:18:30 user nova-compute[72803]:     <video>
Aug 15 07:18:30 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:18:30 user nova-compute[72803]:     </video>
Aug 15 07:18:30 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:18:30 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:18:30 user nova-compute[72803]:     </rng>
Aug 15 07:18:30 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:18:30 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:18:30 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:18:30 user nova-compute[72803]:     </memballoon>
Aug 15 07:18:30 user nova-compute[72803]:   </devices>
Aug 15 07:18:30 user nova-compute[72803]: </domain>
Aug 15 07:18:30 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1154081862',display_name='tempest-TestVolumeBootPattern-server-1154081862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1154081862',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-tfli6ljf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:18:14Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=8f124c37-5cce-4021-bd16-bd01e676d19b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=3f3146f8-bed2-4df2-9fda-31840234ca18,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3146f8-be') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_vif [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=3f3146f8-bed2-4df2-9fda-31840234ca18,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3146f8-be') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[59325079-6e62-4e62-b918-74159fd67e29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87] added
Aug 15 07:18:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f3146f8-be, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f3146f8-be, col_values=(('external_ids', {'iface-id': '3f3146f8-bed2-4df2-9fda-31840234ca18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:a2:9f', 'vm-uuid': '8f124c37-5cce-4021-bd16-bd01e676d19b'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:30 user nova-compute[72803]: INFO os_vif [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=3f3146f8-bed2-4df2-9fda-31840234ca18,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3146f8-be')
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93f121-e59b-4017-aca6-6aa2e8fb6a3c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ad68a4-6281-45b6-9050-d82cac463278]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrAXadlv {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrAXadlv" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e82c8-216d-4e97-8c60-73b59bac9819]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrAXadlv'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No VIF found with MAC fa:16:3e:a2:a2:9f, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.126s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5deff3-07b6-4baa-b3cb-1602718cc7e8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93795e3-2d19-4977-a92b-af47d4f6486f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:18:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:18:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f586862-1b04-4af4-8808-a0711bf7b769]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260]
Aug 15 07:18:30 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260] successful.
Aug 15 07:18:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9409d9a-8e0e-4847-b45e-a5a442a7fca3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cc4594-1758-4253-bd27-6466397457c3]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:18:30 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:18:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:18:30 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:18:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:18:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffca983c-2170-4e40-909a-3953c9674fa8]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:18:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:18:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:18:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '23233313639373232', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233313639373232', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2127844397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-304935621',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9k45/rjpORVh8DYFQ+KcXU5YHBpSbUhTXZlH0Hus32rGVDK580Ryh6t9TFdKiNSDa8Bo8DYL8/TgERDhP7eJUf/qR3DM5r75WovgrSvzC2twKY3xRO2iXmBFEalcyFmQ==',key_name='tempest-keypair-637292857',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:16:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3206b2e9c924b49becaa2ff5b4115e4',ramdisk_id='',reservation_id='r-im66e1d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1796571112',owner_user_name='tempest-ServerActionsV293TestJSON-1796571112-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:18:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d7a7a87dbd1449fb70b8851cf543e42',uuid=632fdd77-c7d3-493b-b8b2-e1a16296fdaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converting VIF {"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:18:32 user nova-compute[72803]:   <uuid>632fdd77-c7d3-493b-b8b2-e1a16296fdaa</uuid>
Aug 15 07:18:32 user nova-compute[72803]:   <name>instance-00000028</name>
Aug 15 07:18:32 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:18:32 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:18:32 user nova-compute[72803]:   <metadata>
Aug 15 07:18:32 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:18:32 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:18:32 user nova-compute[72803]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2127844397</nova:name>
Aug 15 07:18:32 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:18:30</nova:creationTime>
Aug 15 07:18:32 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:18:32 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:18:32 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:18:32 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:18:32 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:18:32 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:18:32 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:18:32 user nova-compute[72803]:       <nova:owner>
Aug 15 07:18:32 user nova-compute[72803]:         <nova:user uuid="4d7a7a87dbd1449fb70b8851cf543e42">tempest-ServerActionsV293TestJSON-1796571112-project-member</nova:user>
Aug 15 07:18:32 user nova-compute[72803]:         <nova:project uuid="a3206b2e9c924b49becaa2ff5b4115e4">tempest-ServerActionsV293TestJSON-1796571112</nova:project>
Aug 15 07:18:32 user nova-compute[72803]:       </nova:owner>
Aug 15 07:18:32 user nova-compute[72803]:       <nova:ports>
Aug 15 07:18:32 user nova-compute[72803]:         <nova:port uuid="19186478-2d79-4d93-9af5-bca0fdea4c79">
Aug 15 07:18:32 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 07:18:32 user nova-compute[72803]:         </nova:port>
Aug 15 07:18:32 user nova-compute[72803]:       </nova:ports>
Aug 15 07:18:32 user nova-compute[72803]:     </nova:instance>
Aug 15 07:18:32 user nova-compute[72803]:   </metadata>
Aug 15 07:18:32 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:18:32 user nova-compute[72803]:     <system>
Aug 15 07:18:32 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:18:32 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:18:32 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:18:32 user nova-compute[72803]:       <entry name="serial">632fdd77-c7d3-493b-b8b2-e1a16296fdaa</entry>
Aug 15 07:18:32 user nova-compute[72803]:       <entry name="uuid">632fdd77-c7d3-493b-b8b2-e1a16296fdaa</entry>
Aug 15 07:18:32 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:18:32 user nova-compute[72803]:     </system>
Aug 15 07:18:32 user nova-compute[72803]:   </sysinfo>
Aug 15 07:18:32 user nova-compute[72803]:   <os>
Aug 15 07:18:32 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:18:32 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:18:32 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:18:32 user nova-compute[72803]:   </os>
Aug 15 07:18:32 user nova-compute[72803]:   <features>
Aug 15 07:18:32 user nova-compute[72803]:     <acpi/>
Aug 15 07:18:32 user nova-compute[72803]:     <apic/>
Aug 15 07:18:32 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:18:32 user nova-compute[72803]:   </features>
Aug 15 07:18:32 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:18:32 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:18:32 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:18:32 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:18:32 user nova-compute[72803]:   </clock>
Aug 15 07:18:32 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:18:32 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:18:32 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:18:32 user nova-compute[72803]:   </cpu>
Aug 15 07:18:32 user nova-compute[72803]:   <devices>
Aug 15 07:18:32 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:18:32 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:18:32 user nova-compute[72803]:       <source dev="/dev/sdc"/>
Aug 15 07:18:32 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:18:32 user nova-compute[72803]:       <serial>84e9ec09-cb51-4a19-aff9-6712b7491d87</serial>
Aug 15 07:18:32 user nova-compute[72803]:     </disk>
Aug 15 07:18:32 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:18:32 user nova-compute[72803]:       <mac address="fa:16:3e:59:61:90"/>
Aug 15 07:18:32 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:18:32 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:18:32 user nova-compute[72803]:       <target dev="tap19186478-2d"/>
Aug 15 07:18:32 user nova-compute[72803]:     </interface>
Aug 15 07:18:32 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:18:32 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/632fdd77-c7d3-493b-b8b2-e1a16296fdaa/console.log" append="off"/>
Aug 15 07:18:32 user nova-compute[72803]:     </serial>
Aug 15 07:18:32 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:18:32 user nova-compute[72803]:     <video>
Aug 15 07:18:32 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:18:32 user nova-compute[72803]:     </video>
Aug 15 07:18:32 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:18:32 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:18:32 user nova-compute[72803]:     </rng>
Aug 15 07:18:32 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:18:32 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:18:32 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:18:32 user nova-compute[72803]:     </memballoon>
Aug 15 07:18:32 user nova-compute[72803]:   </devices>
Aug 15 07:18:32 user nova-compute[72803]: </domain>
Aug 15 07:18:32 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2127844397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-304935621',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9k45/rjpORVh8DYFQ+KcXU5YHBpSbUhTXZlH0Hus32rGVDK580Ryh6t9TFdKiNSDa8Bo8DYL8/TgERDhP7eJUf/qR3DM5r75WovgrSvzC2twKY3xRO2iXmBFEalcyFmQ==',key_name='tempest-keypair-637292857',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:16:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3206b2e9c924b49becaa2ff5b4115e4',ramdisk_id='',reservation_id='r-im66e1d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1796571112',owner_user_name='tempest-ServerActionsV293TestJSON-1796571112-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:18:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d7a7a87dbd1449fb70b8851cf543e42',uuid=632fdd77-c7d3-493b-b8b2-e1a16296fdaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converting VIF {"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG os_vif [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19186478-2d, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19186478-2d, col_values=(('external_ids', {'iface-id': '19186478-2d79-4d93-9af5-bca0fdea4c79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:61:90', 'vm-uuid': '632fdd77-c7d3-493b-b8b2-e1a16296fdaa'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: INFO os_vif [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d')
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] No VIF found with MAC fa:16:3e:59:61:90, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-4727bd45-40d6-4ed7-87c6-23341e1466df req-20f85078-1085-4d6a-9d7d-d5c16a66b641 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received event network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4727bd45-40d6-4ed7-87c6-23341e1466df req-20f85078-1085-4d6a-9d7d-d5c16a66b641 service nova] Acquiring lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4727bd45-40d6-4ed7-87c6-23341e1466df req-20f85078-1085-4d6a-9d7d-d5c16a66b641 service nova] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4727bd45-40d6-4ed7-87c6-23341e1466df req-20f85078-1085-4d6a-9d7d-d5c16a66b641 service nova] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-4727bd45-40d6-4ed7-87c6-23341e1466df req-20f85078-1085-4d6a-9d7d-d5c16a66b641 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] No waiting events found dispatching network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:18:32 user nova-compute[72803]: WARNING nova.compute.manager [req-4727bd45-40d6-4ed7-87c6-23341e1466df req-20f85078-1085-4d6a-9d7d-d5c16a66b641 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received unexpected event network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 for instance with vm_state building and task_state spawning.
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083898.8562286, 489f8bb1-12d2-4ba7-892a-b0906114b572 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:18:33 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] VM Stopped (Lifecycle Event)
Aug 15 07:18:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-945a94c3-6e18-462d-8b29-308c8893f792 None None] [instance: 489f8bb1-12d2-4ba7-892a-b0906114b572] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-f53a267d-074f-4a08-b0fb-c57f2502ac39 req-d21c2684-1ecc-400c-a6f8-8539975f1f0e service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f53a267d-074f-4a08-b0fb-c57f2502ac39 req-d21c2684-1ecc-400c-a6f8-8539975f1f0e service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f53a267d-074f-4a08-b0fb-c57f2502ac39 req-d21c2684-1ecc-400c-a6f8-8539975f1f0e service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f53a267d-074f-4a08-b0fb-c57f2502ac39 req-d21c2684-1ecc-400c-a6f8-8539975f1f0e service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-f53a267d-074f-4a08-b0fb-c57f2502ac39 req-d21c2684-1ecc-400c-a6f8-8539975f1f0e service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] No waiting events found dispatching network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:18:33 user nova-compute[72803]: WARNING nova.compute.manager [req-f53a267d-074f-4a08-b0fb-c57f2502ac39 req-d21c2684-1ecc-400c-a6f8-8539975f1f0e service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received unexpected event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 07:18:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-46719804-0795-4437-a927-cfb084291cb1 req-77fd68de-bb26-4228-adc2-c7da5ea6924f service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received event network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-46719804-0795-4437-a927-cfb084291cb1 req-77fd68de-bb26-4228-adc2-c7da5ea6924f service nova] Acquiring lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-46719804-0795-4437-a927-cfb084291cb1 req-77fd68de-bb26-4228-adc2-c7da5ea6924f service nova] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-46719804-0795-4437-a927-cfb084291cb1 req-77fd68de-bb26-4228-adc2-c7da5ea6924f service nova] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-46719804-0795-4437-a927-cfb084291cb1 req-77fd68de-bb26-4228-adc2-c7da5ea6924f service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] No waiting events found dispatching network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:18:34 user nova-compute[72803]: WARNING nova.compute.manager [req-46719804-0795-4437-a927-cfb084291cb1 req-77fd68de-bb26-4228-adc2-c7da5ea6924f service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received unexpected event network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 for instance with vm_state building and task_state spawning.
Aug 15 07:18:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083915.1168704, 8f124c37-5cce-4021-bd16-bd01e676d19b => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] VM Resumed (Lifecycle Event)
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Instance spawned successfully.
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083915.1225371, 8f124c37-5cce-4021-bd16-bd01e676d19b => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] VM Started (Lifecycle Event)
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Took 21.39 seconds to build instance.
Aug 15 07:18:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7e8a64ee-2d62-48e0-850d-1d01ee28d1f9 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.473s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083915.6916473, 632fdd77-c7d3-493b-b8b2-e1a16296fdaa => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] VM Resumed (Lifecycle Event)
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance spawned successfully.
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083915.6929603, 632fdd77-c7d3-493b-b8b2-e1a16296fdaa => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] VM Started (Lifecycle Event)
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:18:35 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72803) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f9456434-360c-4bd9-b0a3-ef4c5305fe97 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-b2a740e1-19af-4f2f-b3f9-bdc3a47eb4ea req-a97b5821-2f55-4311-873a-f9e17bf83162 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b2a740e1-19af-4f2f-b3f9-bdc3a47eb4ea req-a97b5821-2f55-4311-873a-f9e17bf83162 service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b2a740e1-19af-4f2f-b3f9-bdc3a47eb4ea req-a97b5821-2f55-4311-873a-f9e17bf83162 service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b2a740e1-19af-4f2f-b3f9-bdc3a47eb4ea req-a97b5821-2f55-4311-873a-f9e17bf83162 service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-b2a740e1-19af-4f2f-b3f9-bdc3a47eb4ea req-a97b5821-2f55-4311-873a-f9e17bf83162 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] No waiting events found dispatching network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:18:35 user nova-compute[72803]: WARNING nova.compute.manager [req-b2a740e1-19af-4f2f-b3f9-bdc3a47eb4ea req-a97b5821-2f55-4311-873a-f9e17bf83162 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received unexpected event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 for instance with vm_state active and task_state None.
Aug 15 07:18:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:42 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:42 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:48 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:48 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:18:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:51 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:18:51 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:18:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:18:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:18:51 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:18:51 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updating instance_info_cache with network_info: [{"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:18:55 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:18:55 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=25.129634857177734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f9b55b06-8a65-4202-b494-f4261c872f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 632fdd77-c7d3-493b-b8b2-e1a16296fdaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 89e22ae0-9706-4295-9fdd-97a09b012328 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8f124c37-5cce-4021-bd16-bd01e676d19b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:18:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:18:56 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:18:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:18:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:18:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:18:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'flavor' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:10 user nova-compute[72803]: INFO nova.compute.manager [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Attaching volume 3df9620a-4f01-463e-947e-477db998e0f1 to /dev/vdb
Aug 15 07:19:10 user nova-compute[72803]: DEBUG os_brick.utils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b9721-2add-43cb-a664-eef81a1f0244]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a1a3c9-6f01-47e0-bf24-f5f8c11b1e5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b28654a-bf13-4ce1-8f69-d5aa8dc72635]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc96dfb-039a-4d7f-865b-2424f2babdd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:19:11 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:19:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c17e7d-f12b-4d02-91b5-1de423b1b03e]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG os_brick.utils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:19:11 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating existing volume attachment record: 0b8bd06a-c21b-471b-9dd8-974f0fc1e832 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:19:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:19:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:19:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:19:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:19:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:19:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdVMZnsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:19:19 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:19:19 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:19:19 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe35211-c3f2-4f6d-9702-21a1232cc77c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:19:19 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9192c799-c3ea-476f-a95e-be42b6962f99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1] added
Aug 15 07:19:19 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8daab5-238d-445c-8567-3372dd038a6f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a26331b-efb1-46ab-a4b0-beeb1bee478c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdVMZnsN {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdVMZnsN" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0a4b20-1d78-49a5-b4bb-df2d739fdc2a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gdVMZnsN'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df26b73-4c71-4b4c-813e-bc950eedbfdd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7308a37-08c8-4f37-8586-2a175a34fca1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:20 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:20 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:20 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:20 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:19:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --login" returned: 0 in 1.084s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3b70e0-bf64-4255-a3eb-1c1aae4326a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260]
Aug 15 07:19:21 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260] successful.
Aug 15 07:19:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d79c7-c653-4bad-adb0-da1d71b8c0bf]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[be50c10e-1b7b-430c-b2d8-054f7676932f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:21 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:21 user nova-compute[72803]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:19:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:21 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:21 user nova-compute[72803]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:19:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.343s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.043s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2741d6a-538f-41ca-9ee3-5bda40c68bc6]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-927bfbce-a921-4cd0-97e0-6010833a103d req-387ba0c8-d7a9-4682-851a-9c442acfd98f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-changed-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-927bfbce-a921-4cd0-97e0-6010833a103d req-387ba0c8-d7a9-4682-851a-9c442acfd98f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Refreshing instance network info cache due to event network-changed-b7fa2fa2-1703-498b-b254-99602006af78. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-927bfbce-a921-4cd0-97e0-6010833a103d req-387ba0c8-d7a9-4682-851a-9c442acfd98f service nova] Acquiring lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-927bfbce-a921-4cd0-97e0-6010833a103d req-387ba0c8-d7a9-4682-851a-9c442acfd98f service nova] Acquired lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.network.neutron [req-927bfbce-a921-4cd0-97e0-6010833a103d req-387ba0c8-d7a9-4682-851a-9c442acfd98f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Refreshing network info cache for port b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:21 user nova-compute[72803]: INFO nova.compute.manager [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Terminating instance
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.network.neutron [req-927bfbce-a921-4cd0-97e0-6010833a103d req-387ba0c8-d7a9-4682-851a-9c442acfd98f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updated VIF entry in instance network info cache for port b7fa2fa2-1703-498b-b254-99602006af78. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.network.neutron [req-927bfbce-a921-4cd0-97e0-6010833a103d req-387ba0c8-d7a9-4682-851a-9c442acfd98f service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updating instance_info_cache with network_info: [{"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-f10ee429-54ce-4b38-a43d-f8be02a92d65 req-a2fdf68a-239b-42c4-af6e-af1c15de1cbb service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-vif-unplugged-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f10ee429-54ce-4b38-a43d-f8be02a92d65 req-a2fdf68a-239b-42c4-af6e-af1c15de1cbb service nova] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f10ee429-54ce-4b38-a43d-f8be02a92d65 req-a2fdf68a-239b-42c4-af6e-af1c15de1cbb service nova] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f10ee429-54ce-4b38-a43d-f8be02a92d65 req-a2fdf68a-239b-42c4-af6e-af1c15de1cbb service nova] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-f10ee429-54ce-4b38-a43d-f8be02a92d65 req-a2fdf68a-239b-42c4-af6e-af1c15de1cbb service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] No waiting events found dispatching network-vif-unplugged-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-f10ee429-54ce-4b38-a43d-f8be02a92d65 req-a2fdf68a-239b-42c4-af6e-af1c15de1cbb service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-vif-unplugged-b7fa2fa2-1703-498b-b254-99602006af78 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:19:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-927bfbce-a921-4cd0-97e0-6010833a103d req-387ba0c8-d7a9-4682-851a-9c442acfd98f service nova] Releasing lock "refresh_cache-8d0be6c9-8e93-4a50-bf2b-d287e619b303" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdVMZnsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.405s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] <== connect_volume: return (2407ms) {'type': 'block', 'scsi_wwn': '26361316563613833', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361316563613833', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'flavor' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:19:22 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:19:22 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:19:22 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:19:22 user nova-compute[72803]:   <serial>3df9620a-4f01-463e-947e-477db998e0f1</serial>
Aug 15 07:19:22 user nova-compute[72803]: </disk>
Aug 15 07:19:22 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:19:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Instance destroyed successfully.
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.objects.instance [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lazy-loading 'resources' on Instance uuid 8d0be6c9-8e93-4a50-bf2b-d287e619b303 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-22237353',display_name='tempest-TestStampPattern-server-22237353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-22237353',id=34,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYEdS660yr6zgAKFBXVbvLxAfpYjVGFPDW51c3q4Ydsz8Eye3gBE8udzyAe91FO7kCB6FzhaCGWoXBMPYW0RCVxd9Mg8nCu2yJHA/4Si/grKlEE/CLjLGwDhuMUdNTz9w==',key_name='tempest-TestStampPattern-1230572878',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:12:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adb2074606144e48a856a092c7e32781',ramdisk_id='',reservation_id='r-4y60rw8v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1675165439',owner_user_name='tempest-TestStampPattern-1675165439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:15:16Z,user_data=None,user_id='1ddf3dcceb1f41adbc0f679d1a1014b1',uuid=8d0be6c9-8e93-4a50-bf2b-d287e619b303,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converting VIF {"id": "b7fa2fa2-1703-498b-b254-99602006af78", "address": "fa:16:3e:f5:30:60", "network": {"id": "6b210581-6d0e-43cf-bc0c-0c69b7938714", "bridge": "br-int", "label": "tempest-TestStampPattern-557930575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adb2074606144e48a856a092c7e32781", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7fa2fa2-17", "ovs_interfaceid": "b7fa2fa2-1703-498b-b254-99602006af78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:30:60,bridge_name='br-int',has_traffic_filtering=True,id=b7fa2fa2-1703-498b-b254-99602006af78,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fa2fa2-17') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG os_vif [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:30:60,bridge_name='br-int',has_traffic_filtering=True,id=b7fa2fa2-1703-498b-b254-99602006af78,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fa2fa2-17') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7fa2fa2-17, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:19:22 user nova-compute[72803]: INFO os_vif [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:30:60,bridge_name='br-int',has_traffic_filtering=True,id=b7fa2fa2-1703-498b-b254-99602006af78,network=Network(6b210581-6d0e-43cf-bc0c-0c69b7938714),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7fa2fa2-17')
Aug 15 07:19:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Deleting instance files /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303_del
Aug 15 07:19:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Deletion of /opt/stack/data/nova/instances/8d0be6c9-8e93-4a50-bf2b-d287e619b303_del complete
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No VIF found with MAC fa:16:3e:1b:1a:49, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:19:22 user nova-compute[72803]: INFO nova.compute.manager [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 15 07:19:22 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:19:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b8a5ba7-10ea-42b5-898a-bcac013f86c6 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.057s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:23 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:23 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Took 0.51 seconds to deallocate network for instance.
Aug 15 07:19:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-644e22b9-051a-4c2d-83c0-6987f423f7e6 req-79ce5f61-67cd-43a3-b44f-52dd9bc34387 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-vif-deleted-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:23 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:19:23 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:19:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:23 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Deleted allocations for instance 8d0be6c9-8e93-4a50-bf2b-d287e619b303
Aug 15 07:19:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-79b11e9f-7651-4ed6-891b-95dc2cdd00d0 tempest-TestStampPattern-1675165439 tempest-TestStampPattern-1675165439-project-member] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-086ac234-6a75-45d5-ae7b-4b5eebd9cdf9 req-bf791f3a-c8ae-4e97-aaf4-89e5e3020655 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received event network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-086ac234-6a75-45d5-ae7b-4b5eebd9cdf9 req-bf791f3a-c8ae-4e97-aaf4-89e5e3020655 service nova] Acquiring lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-086ac234-6a75-45d5-ae7b-4b5eebd9cdf9 req-bf791f3a-c8ae-4e97-aaf4-89e5e3020655 service nova] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-086ac234-6a75-45d5-ae7b-4b5eebd9cdf9 req-bf791f3a-c8ae-4e97-aaf4-89e5e3020655 service nova] Lock "8d0be6c9-8e93-4a50-bf2b-d287e619b303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-086ac234-6a75-45d5-ae7b-4b5eebd9cdf9 req-bf791f3a-c8ae-4e97-aaf4-89e5e3020655 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] No waiting events found dispatching network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:24 user nova-compute[72803]: WARNING nova.compute.manager [req-086ac234-6a75-45d5-ae7b-4b5eebd9cdf9 req-bf791f3a-c8ae-4e97-aaf4-89e5e3020655 service nova] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Received unexpected event network-vif-plugged-b7fa2fa2-1703-498b-b254-99602006af78 for instance with vm_state deleted and task_state None.
Aug 15 07:19:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-5785631a-d756-44d8-9ed5-aef7b19da968 req-d55b4d57-6e3a-4dc8-b0d1-4d3670e6b3ea service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-5785631a-d756-44d8-9ed5-aef7b19da968 req-d55b4d57-6e3a-4dc8-b0d1-4d3670e6b3ea service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing instance network info cache due to event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:19:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5785631a-d756-44d8-9ed5-aef7b19da968 req-d55b4d57-6e3a-4dc8-b0d1-4d3670e6b3ea service nova] Acquiring lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:19:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5785631a-d756-44d8-9ed5-aef7b19da968 req-d55b4d57-6e3a-4dc8-b0d1-4d3670e6b3ea service nova] Acquired lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:19:33 user nova-compute[72803]: DEBUG nova.network.neutron [req-5785631a-d756-44d8-9ed5-aef7b19da968 req-d55b4d57-6e3a-4dc8-b0d1-4d3670e6b3ea service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG nova.network.neutron [req-5785631a-d756-44d8-9ed5-aef7b19da968 req-d55b4d57-6e3a-4dc8-b0d1-4d3670e6b3ea service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updated VIF entry in instance network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG nova.network.neutron [req-5785631a-d756-44d8-9ed5-aef7b19da968 req-d55b4d57-6e3a-4dc8-b0d1-4d3670e6b3ea service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating instance_info_cache with network_info: [{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:34 user nova-compute[72803]: INFO nova.compute.manager [None req-325b2f27-3e3b-4bce-9b77-0e59f0da16da tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Unrescuing
Aug 15 07:19:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-325b2f27-3e3b-4bce-9b77-0e59f0da16da tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-325b2f27-3e3b-4bce-9b77-0e59f0da16da tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquired lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG nova.network.neutron [None req-325b2f27-3e3b-4bce-9b77-0e59f0da16da tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5785631a-d756-44d8-9ed5-aef7b19da968 req-d55b4d57-6e3a-4dc8-b0d1-4d3670e6b3ea service nova] Releasing lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG nova.network.neutron [None req-325b2f27-3e3b-4bce-9b77-0e59f0da16da tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-325b2f27-3e3b-4bce-9b77-0e59f0da16da tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Releasing lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:19:34 user nova-compute[72803]: DEBUG nova.objects.instance [None req-325b2f27-3e3b-4bce-9b77-0e59f0da16da tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'flavor' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-c64dad4e-7bed-4335-8aed-ee7eb0170821 req-49a0858b-a193-4aa4-8c4b-bd663e4238e1 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c64dad4e-7bed-4335-8aed-ee7eb0170821 req-49a0858b-a193-4aa4-8c4b-bd663e4238e1 service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c64dad4e-7bed-4335-8aed-ee7eb0170821 req-49a0858b-a193-4aa4-8c4b-bd663e4238e1 service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c64dad4e-7bed-4335-8aed-ee7eb0170821 req-49a0858b-a193-4aa4-8c4b-bd663e4238e1 service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-c64dad4e-7bed-4335-8aed-ee7eb0170821 req-49a0858b-a193-4aa4-8c4b-bd663e4238e1 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:35 user nova-compute[72803]: WARNING nova.compute.manager [req-c64dad4e-7bed-4335-8aed-ee7eb0170821 req-49a0858b-a193-4aa4-8c4b-bd663e4238e1 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:19:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance destroyed successfully.
Aug 15 07:19:36 user nova-compute[72803]: DEBUG nova.compute.manager [req-d5f3d3d5-52e9-4cfc-86f8-ffe52497c76b req-95cca188-0a1e-4b11-9f1a-3f64d75af573 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:36 user nova-compute[72803]: DEBUG nova.compute.manager [req-d5f3d3d5-52e9-4cfc-86f8-ffe52497c76b req-95cca188-0a1e-4b11-9f1a-3f64d75af573 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing instance network info cache due to event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:19:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d5f3d3d5-52e9-4cfc-86f8-ffe52497c76b req-95cca188-0a1e-4b11-9f1a-3f64d75af573 service nova] Acquiring lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:19:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d5f3d3d5-52e9-4cfc-86f8-ffe52497c76b req-95cca188-0a1e-4b11-9f1a-3f64d75af573 service nova] Acquired lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:19:36 user nova-compute[72803]: DEBUG nova.network.neutron [req-d5f3d3d5-52e9-4cfc-86f8-ffe52497c76b req-95cca188-0a1e-4b11-9f1a-3f64d75af573 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:19:36 user nova-compute[72803]: DEBUG nova.network.neutron [req-d5f3d3d5-52e9-4cfc-86f8-ffe52497c76b req-95cca188-0a1e-4b11-9f1a-3f64d75af573 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updated VIF entry in instance network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:19:36 user nova-compute[72803]: DEBUG nova.network.neutron [req-d5f3d3d5-52e9-4cfc-86f8-ffe52497c76b req-95cca188-0a1e-4b11-9f1a-3f64d75af573 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating instance_info_cache with network_info: [{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-d5f3d3d5-52e9-4cfc-86f8-ffe52497c76b req-95cca188-0a1e-4b11-9f1a-3f64d75af573 service nova] Releasing lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:37 user nova-compute[72803]: WARNING nova.compute.manager [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:19:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:37 user nova-compute[72803]: WARNING nova.compute.manager [req-65736f34-aef6-444a-9f04-45c0c7954b56 req-c9bda415-fb62-42d6-a5b2-b0984ce72f7d service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:19:37 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083962.6938148, 8d0be6c9-8e93-4a50-bf2b-d287e619b303 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:19:37 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] VM Stopped (Lifecycle Event)
Aug 15 07:19:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e1b45a59-553d-4bdb-b98e-96864051dff7 None None] [instance: 8d0be6c9-8e93-4a50-bf2b-d287e619b303] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:19:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 39617700-3648-4f38-b129-0c71584828c9 due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083979.158734, 39617700-3648-4f38-b129-0c71584828c9 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:19:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] VM Resumed (Lifecycle Event)
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-325b2f27-3e3b-4bce-9b77-0e59f0da16da tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:19:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083979.1621985, 39617700-3648-4f38-b129-0c71584828c9 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:19:39 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] VM Started (Lifecycle Event)
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-c866818f-04aa-44af-86d2-1e31cfebf7ca req-7f31713d-c28b-4a68-8053-ef80ff35b73b service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c866818f-04aa-44af-86d2-1e31cfebf7ca req-7f31713d-c28b-4a68-8053-ef80ff35b73b service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c866818f-04aa-44af-86d2-1e31cfebf7ca req-7f31713d-c28b-4a68-8053-ef80ff35b73b service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c866818f-04aa-44af-86d2-1e31cfebf7ca req-7f31713d-c28b-4a68-8053-ef80ff35b73b service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-c866818f-04aa-44af-86d2-1e31cfebf7ca req-7f31713d-c28b-4a68-8053-ef80ff35b73b service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:39 user nova-compute[72803]: WARNING nova.compute.manager [req-c866818f-04aa-44af-86d2-1e31cfebf7ca req-7f31713d-c28b-4a68-8053-ef80ff35b73b service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state active and task_state None.
Aug 15 07:19:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:42 user nova-compute[72803]: INFO nova.compute.manager [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Rebooting instance
Aug 15 07:19:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquired lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG nova.network.neutron [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating instance_info_cache with network_info: [{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Releasing lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-e37d3ab5-481c-4ecf-b6e5-29d14399b2cd req-0c2166e1-d374-46e5-9283-ffaeb388072b service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e37d3ab5-481c-4ecf-b6e5-29d14399b2cd req-0c2166e1-d374-46e5-9283-ffaeb388072b service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e37d3ab5-481c-4ecf-b6e5-29d14399b2cd req-0c2166e1-d374-46e5-9283-ffaeb388072b service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e37d3ab5-481c-4ecf-b6e5-29d14399b2cd req-0c2166e1-d374-46e5-9283-ffaeb388072b service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-e37d3ab5-481c-4ecf-b6e5-29d14399b2cd req-0c2166e1-d374-46e5-9283-ffaeb388072b service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:43 user nova-compute[72803]: WARNING nova.compute.manager [req-e37d3ab5-481c-4ecf-b6e5-29d14399b2cd req-0c2166e1-d374-46e5-9283-ffaeb388072b service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state active and task_state reboot_started_hard.
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance destroyed successfully.
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'resources' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-776555605',display_name='tempest-TestMinimumBasicScenario-server-776555605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-776555605',id=41,image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkG8deH+MspIOuSTtsx7S1v+ajnEtABiOWhmo6nYo6CQk5ilKRcV2ltjjvsnm6cm29/DmQyRETgiOoGbj5JLHScL/pb0/Q9tSENW0qlMy6o5W3IpjeOJplFowBjoQlvlw==',key_name='tempest-TestMinimumBasicScenario-1926102892',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-8qtgi0gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:19:43Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=89e22ae0-9706-4295-9fdd-97a09b012328,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_vif [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca02489e-f3, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:19:43 user nova-compute[72803]: INFO os_vif [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3')
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdVMZnsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:19:43 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74856d8-27fd-4899-a7ed-458327ccdccc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192dc8d-2d45-4fc2-8de7-12debf9b8982]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:43 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:43 user nova-compute[72803]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:19:43 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:43 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:43 user nova-compute[72803]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:19:43 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c06b05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[562935ec-45a2-465d-b29e-dfe9ba6d680b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49252ec-eecb-490d-ac5e-1505d5e53d4f]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd52e48-89bf-4465-bed3-7700d60859c6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c018bc52-01dd-44fa-b560-54b5c680c6b1]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77dfd07-41a6-4b9b-a8e1-9d20d7422510]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f64164-41b2-4773-a0f1-40f2f35c29cf]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260]
Aug 15 07:19:43 user nova-compute[72803]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260] successful.
Aug 15 07:19:43 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7527d60c-cfea-46e3-a658-3a9addceee10]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] <== disconnect_volume: return (275ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Start _get_guest_xml network_info=[{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5761c4c-071a-4d72-938b-be1925849dcd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': 'e5761c4c-071a-4d72-938b-be1925849dcd'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '0b8bd06a-c21b-471b-9dd8-974f0fc1e832', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdVMZnsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '89e22ae0-9706-4295-9fdd-97a09b012328', 'attached_at': '', 'detached_at': '', 'volume_id': '3df9620a-4f01-463e-947e-477db998e0f1', 'serial': '3df9620a-4f01-463e-947e-477db998e0f1'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:19:43 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:19:43 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5761c4c-071a-4d72-938b-be1925849dcd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'vcpu_model' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdVMZnsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:19:43 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:19:43 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:19:43 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d94906b-9bb2-4bb5-bdc2-e62bcb6a6a42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:19:43 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db89118-78db-4961-a684-57b0b7bad3a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1] added
Aug 15 07:19:43 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:43 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d97022-eb81-41dd-a101-e6bb24eb2ee1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a83932-6868-455d-984c-1b95adcb1d81]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdVMZnsN {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdVMZnsN" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0891e005-ac6c-4ea2-a993-ace420538a97]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gdVMZnsN'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[94907ba5-80e3-4e14-a9e0-d1728e4ff840]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[896eac09-500f-4bb1-80bf-3027a64a790c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde15d8d-d3c2-4412-95c3-c51256c41e54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260]
Aug 15 07:19:44 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260] successful.
Aug 15 07:19:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[004f62df-c992-4ed3-a5fc-612f4b60a81f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aec46e-72d3-4111-ac11-a775f7c0c3bd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:19:44 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.106s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f9a05-40a1-4c07-a44f-09e4f9a79976]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdVMZnsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-b325b666-1b7f-4df1-98ea-2b1ae655624b req-dc4a8574-1c5e-4db5-8e3f-85a54658a49c service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b325b666-1b7f-4df1-98ea-2b1ae655624b req-dc4a8574-1c5e-4db5-8e3f-85a54658a49c service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b325b666-1b7f-4df1-98ea-2b1ae655624b req-dc4a8574-1c5e-4db5-8e3f-85a54658a49c service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b325b666-1b7f-4df1-98ea-2b1ae655624b req-dc4a8574-1c5e-4db5-8e3f-85a54658a49c service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-b325b666-1b7f-4df1-98ea-2b1ae655624b req-dc4a8574-1c5e-4db5-8e3f-85a54658a49c service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:45 user nova-compute[72803]: WARNING nova.compute.manager [req-b325b666-1b7f-4df1-98ea-2b1ae655624b req-dc4a8574-1c5e-4db5-8e3f-85a54658a49c service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state active and task_state reboot_started_hard.
Aug 15 07:19:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26361316563613833', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361316563613833', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-776555605',display_name='tempest-TestMinimumBasicScenario-server-776555605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-776555605',id=41,image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkG8deH+MspIOuSTtsx7S1v+ajnEtABiOWhmo6nYo6CQk5ilKRcV2ltjjvsnm6cm29/DmQyRETgiOoGbj5JLHScL/pb0/Q9tSENW0qlMy6o5W3IpjeOJplFowBjoQlvlw==',key_name='tempest-TestMinimumBasicScenario-1926102892',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-8qtgi0gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:19:43Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=89e22ae0-9706-4295-9fdd-97a09b012328,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'pci_devices' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:19:45 user nova-compute[72803]:   <uuid>89e22ae0-9706-4295-9fdd-97a09b012328</uuid>
Aug 15 07:19:45 user nova-compute[72803]:   <name>instance-00000029</name>
Aug 15 07:19:45 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:19:45 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:19:45 user nova-compute[72803]:   <metadata>
Aug 15 07:19:45 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:19:45 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:19:45 user nova-compute[72803]:       <nova:name>tempest-TestMinimumBasicScenario-server-776555605</nova:name>
Aug 15 07:19:45 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:19:43</nova:creationTime>
Aug 15 07:19:45 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:19:45 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:19:45 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:19:45 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:19:45 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:19:45 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:19:45 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:19:45 user nova-compute[72803]:       <nova:owner>
Aug 15 07:19:45 user nova-compute[72803]:         <nova:user uuid="76bdfb1f24e5432fbb1946ad1875a8f9">tempest-TestMinimumBasicScenario-1832153355-project-member</nova:user>
Aug 15 07:19:45 user nova-compute[72803]:         <nova:project uuid="35db591e3ed243128111721ee0e6c276">tempest-TestMinimumBasicScenario-1832153355</nova:project>
Aug 15 07:19:45 user nova-compute[72803]:       </nova:owner>
Aug 15 07:19:45 user nova-compute[72803]:       <nova:root type="image" uuid="e5761c4c-071a-4d72-938b-be1925849dcd"/>
Aug 15 07:19:45 user nova-compute[72803]:       <nova:ports>
Aug 15 07:19:45 user nova-compute[72803]:         <nova:port uuid="ca02489e-f336-4167-97a6-cf56edc6c64b">
Aug 15 07:19:45 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:19:45 user nova-compute[72803]:         </nova:port>
Aug 15 07:19:45 user nova-compute[72803]:       </nova:ports>
Aug 15 07:19:45 user nova-compute[72803]:     </nova:instance>
Aug 15 07:19:45 user nova-compute[72803]:   </metadata>
Aug 15 07:19:45 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:19:45 user nova-compute[72803]:     <system>
Aug 15 07:19:45 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:19:45 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:19:45 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:19:45 user nova-compute[72803]:       <entry name="serial">89e22ae0-9706-4295-9fdd-97a09b012328</entry>
Aug 15 07:19:45 user nova-compute[72803]:       <entry name="uuid">89e22ae0-9706-4295-9fdd-97a09b012328</entry>
Aug 15 07:19:45 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:19:45 user nova-compute[72803]:     </system>
Aug 15 07:19:45 user nova-compute[72803]:   </sysinfo>
Aug 15 07:19:45 user nova-compute[72803]:   <os>
Aug 15 07:19:45 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:19:45 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:19:45 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:19:45 user nova-compute[72803]:   </os>
Aug 15 07:19:45 user nova-compute[72803]:   <features>
Aug 15 07:19:45 user nova-compute[72803]:     <acpi/>
Aug 15 07:19:45 user nova-compute[72803]:     <apic/>
Aug 15 07:19:45 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:19:45 user nova-compute[72803]:   </features>
Aug 15 07:19:45 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:19:45 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:19:45 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:19:45 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:19:45 user nova-compute[72803]:   </clock>
Aug 15 07:19:45 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:19:45 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:19:45 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:19:45 user nova-compute[72803]:   </cpu>
Aug 15 07:19:45 user nova-compute[72803]:   <devices>
Aug 15 07:19:45 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:19:45 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:19:45 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk"/>
Aug 15 07:19:45 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:19:45 user nova-compute[72803]:     </disk>
Aug 15 07:19:45 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:19:45 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:19:45 user nova-compute[72803]:       <source dev="/dev/sdd"/>
Aug 15 07:19:45 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:19:45 user nova-compute[72803]:       <serial>3df9620a-4f01-463e-947e-477db998e0f1</serial>
Aug 15 07:19:45 user nova-compute[72803]:     </disk>
Aug 15 07:19:45 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:19:45 user nova-compute[72803]:       <mac address="fa:16:3e:1b:1a:49"/>
Aug 15 07:19:45 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:19:45 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:19:45 user nova-compute[72803]:       <target dev="tapca02489e-f3"/>
Aug 15 07:19:45 user nova-compute[72803]:     </interface>
Aug 15 07:19:45 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:19:45 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/console.log" append="off"/>
Aug 15 07:19:45 user nova-compute[72803]:     </serial>
Aug 15 07:19:45 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:19:45 user nova-compute[72803]:     <video>
Aug 15 07:19:45 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:19:45 user nova-compute[72803]:     </video>
Aug 15 07:19:45 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:19:45 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:19:45 user nova-compute[72803]:     </rng>
Aug 15 07:19:45 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:19:45 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:19:45 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:19:45 user nova-compute[72803]:     </memballoon>
Aug 15 07:19:45 user nova-compute[72803]:   </devices>
Aug 15 07:19:45 user nova-compute[72803]: </domain>
Aug 15 07:19:45 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'trusted_certs' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 --force-share --output=json" returned: 0 in 0.167s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:19:45 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Cannot resize image /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG nova.objects.instance [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'migration_context' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-776555605',display_name='tempest-TestMinimumBasicScenario-server-776555605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-776555605',id=41,image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkG8deH+MspIOuSTtsx7S1v+ajnEtABiOWhmo6nYo6CQk5ilKRcV2ltjjvsnm6cm29/DmQyRETgiOoGbj5JLHScL/pb0/Q9tSENW0qlMy6o5W3IpjeOJplFowBjoQlvlw==',key_name='tempest-TestMinimumBasicScenario-1926102892',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-8qtgi0gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:19:43Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=89e22ae0-9706-4295-9fdd-97a09b012328,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG os_vif [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca02489e-f3, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca02489e-f3, col_values=(('external_ids', {'iface-id': 'ca02489e-f336-4167-97a6-cf56edc6c64b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:1a:49', 'vm-uuid': '89e22ae0-9706-4295-9fdd-97a09b012328'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:19:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:46 user nova-compute[72803]: INFO os_vif [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3')
Aug 15 07:19:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-f1080f29-1d59-4771-b493-118b5890f07e req-0868a954-9216-4a2a-947d-a924fe34ac8d service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f1080f29-1d59-4771-b493-118b5890f07e req-0868a954-9216-4a2a-947d-a924fe34ac8d service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f1080f29-1d59-4771-b493-118b5890f07e req-0868a954-9216-4a2a-947d-a924fe34ac8d service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f1080f29-1d59-4771-b493-118b5890f07e req-0868a954-9216-4a2a-947d-a924fe34ac8d service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:47 user nova-compute[72803]: DEBUG nova.compute.manager [req-f1080f29-1d59-4771-b493-118b5890f07e req-0868a954-9216-4a2a-947d-a924fe34ac8d service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:47 user nova-compute[72803]: WARNING nova.compute.manager [req-f1080f29-1d59-4771-b493-118b5890f07e req-0868a954-9216-4a2a-947d-a924fe34ac8d service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state active and task_state reboot_started_hard.
Aug 15 07:19:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 89e22ae0-9706-4295-9fdd-97a09b012328 due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083989.4352734, 89e22ae0-9706-4295-9fdd-97a09b012328 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:19:49 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] VM Resumed (Lifecycle Event)
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:19:49 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance rebooted successfully.
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:19:49 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692083989.438839, 89e22ae0-9706-4295-9fdd-97a09b012328 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:19:49 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] VM Started (Lifecycle Event)
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-7df77734-1727-43ce-8625-0db3dfd7a6b9 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.366s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-23f723b6-a9c8-4bf9-8027-df09f7186eac req-d4fb7cce-2822-48ca-a64e-4a776048a80d service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-23f723b6-a9c8-4bf9-8027-df09f7186eac req-d4fb7cce-2822-48ca-a64e-4a776048a80d service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-23f723b6-a9c8-4bf9-8027-df09f7186eac req-d4fb7cce-2822-48ca-a64e-4a776048a80d service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-23f723b6-a9c8-4bf9-8027-df09f7186eac req-d4fb7cce-2822-48ca-a64e-4a776048a80d service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-23f723b6-a9c8-4bf9-8027-df09f7186eac req-d4fb7cce-2822-48ca-a64e-4a776048a80d service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:49 user nova-compute[72803]: WARNING nova.compute.manager [req-23f723b6-a9c8-4bf9-8027-df09f7186eac req-d4fb7cce-2822-48ca-a64e-4a776048a80d service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state active and task_state None.
Aug 15 07:19:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'flavor' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:50 user nova-compute[72803]: INFO nova.compute.manager [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Attaching volume 45e3d123-2e90-4554-b6a0-10beb3462be6 to /dev/vdb
Aug 15 07:19:50 user nova-compute[72803]: DEBUG os_brick.utils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69d9831-3544-4fec-8364-c0bfb60fa1b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fb063a-6d8b-4928-b1d4-5089d7f4d5f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c851eaeb-6f2e-44d1-9c19-87e111f93911]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[34064202-04ec-42fd-93e1-5162f09d2e00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:19:50 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:19:50 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b40c632-def3-4311-a4b9-386edb2e4ff2]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG os_brick.utils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:19:50 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating existing volume attachment record: e896d712-9c64-4fdc-a436-5160396f5a0b {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:19:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:52 user nova-compute[72803]: INFO nova.compute.manager [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Terminating instance
Aug 15 07:19:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:19:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-48b369d7-b95a-4456-a9c6-0c0571e9292c req-e26cc8e1-e1c6-490d-87eb-5574ce38094d service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-unplugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-48b369d7-b95a-4456-a9c6-0c0571e9292c req-e26cc8e1-e1c6-490d-87eb-5574ce38094d service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-48b369d7-b95a-4456-a9c6-0c0571e9292c req-e26cc8e1-e1c6-490d-87eb-5574ce38094d service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-48b369d7-b95a-4456-a9c6-0c0571e9292c req-e26cc8e1-e1c6-490d-87eb-5574ce38094d service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-48b369d7-b95a-4456-a9c6-0c0571e9292c req-e26cc8e1-e1c6-490d-87eb-5574ce38094d service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] No waiting events found dispatching network-vif-unplugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-48b369d7-b95a-4456-a9c6-0c0571e9292c req-e26cc8e1-e1c6-490d-87eb-5574ce38094d service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-unplugged-19186478-2d79-4d93-9af5-bca0fdea4c79 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Instance destroyed successfully.
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.objects.instance [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lazy-loading 'resources' on Instance uuid 632fdd77-c7d3-493b-b8b2-e1a16296fdaa {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T07:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2127844397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-304935621',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9k45/rjpORVh8DYFQ+KcXU5YHBpSbUhTXZlH0Hus32rGVDK580Ryh6t9TFdKiNSDa8Bo8DYL8/TgERDhP7eJUf/qR3DM5r75WovgrSvzC2twKY3xRO2iXmBFEalcyFmQ==',key_name='tempest-keypair-637292857',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3206b2e9c924b49becaa2ff5b4115e4',ramdisk_id='',reservation_id='r-im66e1d1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1796571112',owner_user_name='tempest-ServerActionsV293TestJSON-1796571112-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:18:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d7a7a87dbd1449fb70b8851cf543e42',uuid=632fdd77-c7d3-493b-b8b2-e1a16296fdaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converting VIF {"id": "19186478-2d79-4d93-9af5-bca0fdea4c79", "address": "fa:16:3e:59:61:90", "network": {"id": "c97ed0cf-a53b-4e16-8087-2941ea96d283", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2084721354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3206b2e9c924b49becaa2ff5b4115e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19186478-2d", "ovs_interfaceid": "19186478-2d79-4d93-9af5-bca0fdea4c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_vif [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19186478-2d, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:53 user nova-compute[72803]: INFO os_vif [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:61:90,bridge_name='br-int',has_traffic_filtering=True,id=19186478-2d79-4d93-9af5-bca0fdea4c79,network=Network(c97ed0cf-a53b-4e16-8087-2941ea96d283),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19186478-2d')
Aug 15 07:19:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrAXadlv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:19:53 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[933a18f0-9e30-4d2e-8a13-1aa7588b6f3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7686a72-a779-4050-9d6c-5101070d5c06]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:53 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:53 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:19:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:19:53 user nova-compute[72803]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 (non-flash)
Aug 15 07:19:53 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:19:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c06b28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a57685e-1f38-42ff-9390-7e5a0ff25e34]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df3e446-f32c-4d47-9689-37255be49c0a]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb47f83a-75da-409b-a534-f06965a393f3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cee0cf-00da-4117-a114-edf7e32ae85b]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO935bcdcf-2316972205467908', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_935bcdcf') {{(pid=84151) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 07:19:53 user nova-compute[72803]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO935bcdcf-2316972205467908
Aug 15 07:19:53 user nova-compute[72803]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_935bcdcf
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[996989b2-3dd1-4b53-8af4-ffa4ccf7daaf]: (4, None) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e36d4-759b-46e1-b348-c9611aa70d9e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2f3b4d-6f51-4e83-b84a-401265e8ab3f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260]
Aug 15 07:19:54 user nova-compute[72803]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87, portal: 172.16.0.220,3260] successful.
Aug 15 07:19:54 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e9ec09-cb51-4a19-aff9-6712b7491d87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[07000688-02fa-45c6-81d3-52eb5737493f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] <== disconnect_volume: return (316ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:19:54 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Deleting instance files /opt/stack/data/nova/instances/632fdd77-c7d3-493b-b8b2-e1a16296fdaa_del
Aug 15 07:19:54 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Deletion of /opt/stack/data/nova/instances/632fdd77-c7d3-493b-b8b2-e1a16296fdaa_del complete
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:54 user nova-compute[72803]: INFO nova.compute.manager [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:19:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:55 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:19:55 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8013MB free_disk=25.23635482788086GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-5d3a9dee-b487-459c-a34b-4a656ddbb770 req-cf0bcb52-471c-4066-ab0c-3a0c4eee6879 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-deleted-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:55 user nova-compute[72803]: INFO nova.compute.manager [req-5d3a9dee-b487-459c-a34b-4a656ddbb770 req-cf0bcb52-471c-4066-ab0c-3a0c4eee6879 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Neutron deleted interface 19186478-2d79-4d93-9af5-bca0fdea4c79; detaching it from the instance and deleting it from the info cache
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.network.neutron [req-5d3a9dee-b487-459c-a34b-4a656ddbb770 req-cf0bcb52-471c-4066-ab0c-3a0c4eee6879 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:55 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Took 1.09 seconds to deallocate network for instance.
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-5d3a9dee-b487-459c-a34b-4a656ddbb770 req-cf0bcb52-471c-4066-ab0c-3a0c4eee6879 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Detach interface failed, port_id=19186478-2d79-4d93-9af5-bca0fdea4c79, reason: Instance 632fdd77-c7d3-493b-b8b2-e1a16296fdaa could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f9b55b06-8a65-4202-b494-f4261c872f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 632fdd77-c7d3-493b-b8b2-e1a16296fdaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 89e22ae0-9706-4295-9fdd-97a09b012328 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 8f124c37-5cce-4021-bd16-bd01e676d19b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-3c8e3f51-30a9-4ae4-adef-af7fc2909c6f req-b4b0e265-dcc9-46b9-bc27-5de89cdeede1 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c8e3f51-30a9-4ae4-adef-af7fc2909c6f req-b4b0e265-dcc9-46b9-bc27-5de89cdeede1 service nova] Acquiring lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c8e3f51-30a9-4ae4-adef-af7fc2909c6f req-b4b0e265-dcc9-46b9-bc27-5de89cdeede1 service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3c8e3f51-30a9-4ae4-adef-af7fc2909c6f req-b4b0e265-dcc9-46b9-bc27-5de89cdeede1 service nova] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-3c8e3f51-30a9-4ae4-adef-af7fc2909c6f req-b4b0e265-dcc9-46b9-bc27-5de89cdeede1 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] No waiting events found dispatching network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:19:55 user nova-compute[72803]: WARNING nova.compute.manager [req-3c8e3f51-30a9-4ae4-adef-af7fc2909c6f req-b4b0e265-dcc9-46b9-bc27-5de89cdeede1 service nova] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Received unexpected event network-vif-plugged-19186478-2d79-4d93-9af5-bca0fdea4c79 for instance with vm_state active and task_state deleting.
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:19:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:56 user nova-compute[72803]: INFO nova.compute.manager [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Took 0.86 seconds to detach 1 volumes for instance.
Aug 15 07:19:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Deleting volume: 84e9ec09-cb51-4a19-aff9-6712b7491d87 {{(pid=72803) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:19:56 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Deleted allocations for instance 632fdd77-c7d3-493b-b8b2-e1a16296fdaa
Aug 15 07:19:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:19:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-df6630da-c7ac-430b-b1f1-ff2dd4ac2cf4 tempest-ServerActionsV293TestJSON-1796571112 tempest-ServerActionsV293TestJSON-1796571112-project-member] Lock "632fdd77-c7d3-493b-b8b2-e1a16296fdaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.760s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:19:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:19:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:19:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:19:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:19:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:19:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEMUXkAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:20:00 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:20:00 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:20:00 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b47783f-0820-4f94-ab2d-b373a8712de9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:20:00 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0916c23f-153f-4167-a8b8-763f33ae4346]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6] added
Aug 15 07:20:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb16f76-0eae-4dcf-88b8-5b44ca13c054]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[82258957-ef62-4aed-a739-cc16f9f360e1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEMUXkAg {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEMUXkAg" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c317e84b-e581-460b-8669-1af57ef2d556]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pEMUXkAg'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391890e-6efa-42c0-9054-b6fca161f2ab]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8719a3db-449b-4320-8ec6-18cb81907f6a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6240e2-1b7a-4290-8d06-6bb36d8f907f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6, portal: 172.16.0.220,3260]
Aug 15 07:20:00 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6, portal: 172.16.0.220,3260] successful.
Aug 15 07:20:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a5197b-7022-458d-a911-f43e1a9b7052]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2c6d1a-9b66-4206-a94c-a18084b7a0dd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:20:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[49991cc4-3714-46c9-99dd-18338f30786f]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:00 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEMUXkAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23235333135643461', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235333135643461', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'flavor' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:20:01 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:20:01 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:20:01 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:20:01 user nova-compute[72803]:   <serial>45e3d123-2e90-4554-b6a0-10beb3462be6</serial>
Aug 15 07:20:01 user nova-compute[72803]: </disk>
Aug 15 07:20:01 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:20:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No VIF found with MAC fa:16:3e:f0:3c:bc, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:20:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d85004c4-cfef-48ea-92de-8fc1307d1415 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.507s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:02 user nova-compute[72803]: INFO nova.compute.manager [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Rescuing
Aug 15 07:20:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:20:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquired lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:20:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Releasing lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-eb05c617-4ed4-4226-8a01-4495b3f27f40 req-71353289-da7a-4fc5-ad18-a0a7176f77bb service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eb05c617-4ed4-4226-8a01-4495b3f27f40 req-71353289-da7a-4fc5-ad18-a0a7176f77bb service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eb05c617-4ed4-4226-8a01-4495b3f27f40 req-71353289-da7a-4fc5-ad18-a0a7176f77bb service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eb05c617-4ed4-4226-8a01-4495b3f27f40 req-71353289-da7a-4fc5-ad18-a0a7176f77bb service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-eb05c617-4ed4-4226-8a01-4495b3f27f40 req-71353289-da7a-4fc5-ad18-a0a7176f77bb service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:20:03 user nova-compute[72803]: WARNING nova.compute.manager [req-eb05c617-4ed4-4226-8a01-4495b3f27f40 req-71353289-da7a-4fc5-ad18-a0a7176f77bb service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state active and task_state rescuing.
Aug 15 07:20:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance destroyed successfully.
Aug 15 07:20:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Attempting a stable device rescue
Aug 15 07:20:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72803) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 07:20:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance directory exists: not creating {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 07:20:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Creating image(s)
Aug 15 07:20:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:04 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:20:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "8f124c37-5cce-4021-bd16-bd01e676d19b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:05 user nova-compute[72803]: INFO nova.compute.manager [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Terminating instance
Aug 15 07:20:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e.part --force-share --output=json" returned: 0 in 0.225s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG nova.virt.images [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] a198f07f-52b9-4841-ae69-b6162b29b4cc was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e.part /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-da7f9808-bba2-4b9a-8745-26154b950291 req-47d82ba1-eea4-42b6-bbeb-937ac64cb8bb service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-da7f9808-bba2-4b9a-8745-26154b950291 req-47d82ba1-eea4-42b6-bbeb-937ac64cb8bb service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-da7f9808-bba2-4b9a-8745-26154b950291 req-47d82ba1-eea4-42b6-bbeb-937ac64cb8bb service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-da7f9808-bba2-4b9a-8745-26154b950291 req-47d82ba1-eea4-42b6-bbeb-937ac64cb8bb service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-da7f9808-bba2-4b9a-8745-26154b950291 req-47d82ba1-eea4-42b6-bbeb-937ac64cb8bb service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:20:05 user nova-compute[72803]: WARNING nova.compute.manager [req-da7f9808-bba2-4b9a-8745-26154b950291 req-47d82ba1-eea4-42b6-bbeb-937ac64cb8bb service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state active and task_state rescuing.
Aug 15 07:20:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-bb509dcb-c42b-4d5c-88ba-646de03ccf3a req-2600dd3e-bb51-427a-a6e1-0f442e3fd524 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received event network-vif-unplugged-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bb509dcb-c42b-4d5c-88ba-646de03ccf3a req-2600dd3e-bb51-427a-a6e1-0f442e3fd524 service nova] Acquiring lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bb509dcb-c42b-4d5c-88ba-646de03ccf3a req-2600dd3e-bb51-427a-a6e1-0f442e3fd524 service nova] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bb509dcb-c42b-4d5c-88ba-646de03ccf3a req-2600dd3e-bb51-427a-a6e1-0f442e3fd524 service nova] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-bb509dcb-c42b-4d5c-88ba-646de03ccf3a req-2600dd3e-bb51-427a-a6e1-0f442e3fd524 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] No waiting events found dispatching network-vif-unplugged-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:20:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-bb509dcb-c42b-4d5c-88ba-646de03ccf3a req-2600dd3e-bb51-427a-a6e1-0f442e3fd524 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received event network-vif-unplugged-3f3146f8-bed2-4df2-9fda-31840234ca18 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e.part /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e.converted" returned: 0 in 0.580s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Instance destroyed successfully.
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'resources' on Instance uuid 8f124c37-5cce-4021-bd16-bd01e676d19b {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1154081862',display_name='tempest-TestVolumeBootPattern-server-1154081862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1154081862',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-tfli6ljf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:18:35Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=8f124c37-5cce-4021-bd16-bd01e676d19b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "3f3146f8-bed2-4df2-9fda-31840234ca18", "address": "fa:16:3e:a2:a2:9f", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f3146f8-be", "ovs_interfaceid": "3f3146f8-bed2-4df2-9fda-31840234ca18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=3f3146f8-bed2-4df2-9fda-31840234ca18,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3146f8-be') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_vif [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=3f3146f8-bed2-4df2-9fda-31840234ca18,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3146f8-be') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f3146f8-be, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:06 user nova-compute[72803]: INFO os_vif [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a2:9f,bridge_name='br-int',has_traffic_filtering=True,id=3f3146f8-bed2-4df2-9fda-31840234ca18,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f3146f8-be')
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsjXEfZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:20:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.084s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3912a425-6b7f-4fcc-acb0-ac824a1a85ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa308019-c66e-40c0-bd38-369517549eae]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c05b4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca67812-c6b4-4da4-b74c-3d72e8cccb9c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde19b3-fd0d-4e86-8687-70b3de1c71b3]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b1cffc-d0c2-411f-9b57-f2ccbc765dae]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e,backing_fmt=raw /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.rescue {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b08bb9-7dd4-4e7f-aec3-34a05fcec5ae]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e,backing_fmt=raw /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.rescue" returned: 0 in 0.055s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'migration_context' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b36112-df0e-406d-a3b8-cb34051c6638]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Start _get_guest_xml network_info=[{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "vif_mac": "fa:16:3e:f0:3c:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a198f07f-52b9-4841-ae69-b6162b29b4cc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'e896d712-9c64-4fdc-a436-5160396f5a0b', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEMUXkAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f9b55b06-8a65-4202-b494-f4261c872f62', 'attached_at': '', 'detached_at': '', 'volume_id': '45e3d123-2e90-4554-b6a0-10beb3462be6', 'serial': '45e3d123-2e90-4554-b6a0-10beb3462be6'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'resources' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'numa_topology' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c0ccb-ae09-49bb-9c93-9d59ef084347]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306, portal: 172.16.0.220,3260]
Aug 15 07:20:06 user nova-compute[72803]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306, portal: 172.16.0.220,3260] successful.
Aug 15 07:20:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:20:06 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e70262c9-04cc-4d61-bfc8-02454bf3f306 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa2fe8e-afdd-4ad0-ae6a-a92e1c6a6f4f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== disconnect_volume: return (354ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:20:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Deleting instance files /opt/stack/data/nova/instances/8f124c37-5cce-4021-bd16-bd01e676d19b_del
Aug 15 07:20:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Deletion of /opt/stack/data/nova/instances/8f124c37-5cce-4021-bd16-bd01e676d19b_del complete
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEMUXkAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:20:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:20:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:20:06 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6698639-4107-4b2f-8577-1ade46e9d533]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pEMUXkAg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 07:20:06 user nova-compute[72803]: node.name = iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6
Aug 15 07:20:06 user nova-compute[72803]: node.tpgt = -1
Aug 15 07:20:06 user nova-compute[72803]: node.startup = automatic
Aug 15 07:20:06 user nova-compute[72803]: node.leading_login = No
Aug 15 07:20:06 user nova-compute[72803]: iface.iscsi_ifacename = default
Aug 15 07:20:06 user nova-compute[72803]: iface.net_ifacename = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.ipaddress = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.prefix_len = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.hwaddress = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.transport_name = tcp
Aug 15 07:20:06 user nova-compute[72803]: iface.initiatorname = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.state = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.vlan_id = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.vlan_priority = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.vlan_state = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.iface_num = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.mtu = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.port = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.bootproto = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.subnet_mask = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.gateway = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.dhcp_alt_client_id = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.dhcp_dns = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.dhcp_learn_iqn = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.dhcp_vendor_id_state = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.dhcp_vendor_id = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.dhcp_slp_da = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.fragmentation = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.gratuitous_arp = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.incoming_forwarding = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.tos_state = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.tos = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.ttl = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.delayed_ack = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.tcp_nagle = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.tcp_wsf_state = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.tcp_wsf = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.tcp_timer_scale = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.tcp_timestamp = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.redirect = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.def_task_mgmt_timeout = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.header_digest = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.data_digest = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.immediate_data = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.initial_r2t = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.data_seq_inorder = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.data_pdu_inorder = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.erl = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.max_receive_data_len = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.first_burst_len = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.max_outstanding_r2t = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.max_burst_len = 0
Aug 15 07:20:06 user nova-compute[72803]: iface.chap_auth = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.bidi_chap = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.strict_login_compliance = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.discovery_auth = <empty>
Aug 15 07:20:06 user nova-compute[72803]: iface.discovery_logout = <empty>
Aug 15 07:20:06 user nova-compute[72803]: node.discovery_address = <empty>
Aug 15 07:20:06 user nova-compute[72803]: node.discovery_port = 0
Aug 15 07:20:06 user nova-compute[72803]: node.discovery_type = static
Aug 15 07:20:06 user nova-compute[72803]: node.session.initial_cmdsn = 0
Aug 15 07:20:06 user nova-compute[72803]: node.session.initial_login_retry_max = 8
Aug 15 07:20:06 user nova-compute[72803]: node.session.xmit_thread_priority = -20
Aug 15 07:20:06 user nova-compute[72803]: node.session.cmds_max = 128
Aug 15 07:20:06 user nova-compute[72803]: node.session.queue_depth = 32
Aug 15 07:20:06 user nova-compute[72803]: node.session.nr_sessions = 1
Aug 15 07:20:06 user nova-compute[72803]: node.session.auth.authmethod = CHAP
Aug 15 07:20:06 user nova-compute[72803]: node.session.auth.username = pEMUXkAg
Aug 15 07:20:06 user nova-compute[72803]: node.session.auth.password = ***
Aug 15 07:20:06 user nova-compute[72803]: node.session.auth.username_in = <empty>
Aug 15 07:20:06 user nova-compute[72803]: node.session.auth.password_in = <empty>
Aug 15 07:20:06 user nova-compute[72803]: node.session.auth.chap_algs = MD5
Aug 15 07:20:06 user nova-compute[72803]: node.session.timeo.replacement_timeout = 120
Aug 15 07:20:06 user nova-compute[72803]: node.session.err_timeo.abort_timeout = 15
Aug 15 07:20:06 user nova-compute[72803]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 07:20:06 user nova-compute[72803]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 07:20:06 user nova-compute[72803]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.FastAbort = Yes
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.InitialR2T = No
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.ImmediateData = Yes
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.MaxConnections = 1
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 07:20:06 user nova-compute[72803]: node.session.iscsi.ERL = 0
Aug 15 07:20:06 user nova-compute[72803]: node.session.scan = manual
Aug 15 07:20:06 user nova-compute[72803]: node.session.reopen_max = 0
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].address = 172.16.0.220
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].port = 3260
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].startup = manual
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].tcp.window_size = 524288
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].tcp.type_of_service = 0
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].timeo.logout_timeout = 15
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].timeo.login_timeout = 15
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].timeo.auth_timeout = 45
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].iscsi.DataDigest = None
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].iscsi.IFMarker = No
Aug 15 07:20:06 user nova-compute[72803]: node.conn[0].iscsi.OFMarker = No
Aug 15 07:20:06 user nova-compute[72803]: # END RECORD
Aug 15 07:20:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: INFO nova.compute.manager [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d4be80-e00d-49cd-b7e6-1799f3b5da35]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a66a2a-d0c5-449a-8ed4-4e9746c25434]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEMUXkAg {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEMUXkAg" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe3ba1-2493-4395-a6e8-79f0bbf6a7fb]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pEMUXkAg'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ae680d-6bc9-432e-b9cf-2ad49ee7f710]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8204767-2e01-4ff2-9e70-95562e132602]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:20:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.151s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] HCTL ('34', '0', '0', 0) found on session 51 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb979d1-8af1-4751-8c43-f1a041a50f04]: (4, ('0 0 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Searching for a device in session 51 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEMUXkAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '23235333135643461', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235333135643461', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2114399517',display_name='tempest-ServerStableDeviceRescueTest-server-2114399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2114399517',id=39,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH3mRkT28QKSLpSuGqX9AbaFPnxcddlyqDTSGZ9EFwfhLJPio+bIowVDYW2fMsqSTRbt/7DHWSCvTNsOd68YHCEGyZujDOlZntS5tJ4k2VXhpBokRvJxeGYOLUESSDlvg==',key_name='tempest-keypair-1111085751',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:16:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee2fb93a370a4fa0badb369280adb602',ramdisk_id='',reservation_id='r-6iw9rbgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-473594700',owner_user_name='tempest-ServerStableDeviceRescueTest-473594700-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580a8d3496704b25b33f67cfb21e6d5b',uuid=f9b55b06-8a65-4202-b494-f4261c872f62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "vif_mac": "fa:16:3e:f0:3c:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Converting VIF {"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "vif_mac": "fa:16:3e:f0:3c:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2cc6417-2234-4954-b1a8-d51f14da390f,network=Network(6192a07b-dedb-4cf9-8538-7c722b450542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cc6417-22') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'pci_devices' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:20:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:20:06 user nova-compute[72803]:   <uuid>f9b55b06-8a65-4202-b494-f4261c872f62</uuid>
Aug 15 07:20:06 user nova-compute[72803]:   <name>instance-00000027</name>
Aug 15 07:20:06 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:20:06 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:20:06 user nova-compute[72803]:   <metadata>
Aug 15 07:20:06 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:20:06 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:20:06 user nova-compute[72803]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2114399517</nova:name>
Aug 15 07:20:06 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:20:06</nova:creationTime>
Aug 15 07:20:06 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:20:06 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:20:06 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:20:06 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:20:06 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:20:06 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:20:06 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:20:06 user nova-compute[72803]:       <nova:owner>
Aug 15 07:20:06 user nova-compute[72803]:         <nova:user uuid="580a8d3496704b25b33f67cfb21e6d5b">tempest-ServerStableDeviceRescueTest-473594700-project-member</nova:user>
Aug 15 07:20:06 user nova-compute[72803]:         <nova:project uuid="ee2fb93a370a4fa0badb369280adb602">tempest-ServerStableDeviceRescueTest-473594700</nova:project>
Aug 15 07:20:06 user nova-compute[72803]:       </nova:owner>
Aug 15 07:20:06 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:20:06 user nova-compute[72803]:       <nova:ports>
Aug 15 07:20:06 user nova-compute[72803]:         <nova:port uuid="f2cc6417-2234-4954-b1a8-d51f14da390f">
Aug 15 07:20:06 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 07:20:06 user nova-compute[72803]:         </nova:port>
Aug 15 07:20:06 user nova-compute[72803]:       </nova:ports>
Aug 15 07:20:06 user nova-compute[72803]:     </nova:instance>
Aug 15 07:20:06 user nova-compute[72803]:   </metadata>
Aug 15 07:20:06 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:20:06 user nova-compute[72803]:     <system>
Aug 15 07:20:06 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:20:06 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:20:06 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:20:06 user nova-compute[72803]:       <entry name="serial">f9b55b06-8a65-4202-b494-f4261c872f62</entry>
Aug 15 07:20:06 user nova-compute[72803]:       <entry name="uuid">f9b55b06-8a65-4202-b494-f4261c872f62</entry>
Aug 15 07:20:06 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:20:06 user nova-compute[72803]:     </system>
Aug 15 07:20:06 user nova-compute[72803]:   </sysinfo>
Aug 15 07:20:06 user nova-compute[72803]:   <os>
Aug 15 07:20:06 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:20:06 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:20:06 user nova-compute[72803]:   </os>
Aug 15 07:20:06 user nova-compute[72803]:   <features>
Aug 15 07:20:06 user nova-compute[72803]:     <acpi/>
Aug 15 07:20:06 user nova-compute[72803]:     <apic/>
Aug 15 07:20:06 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:20:06 user nova-compute[72803]:   </features>
Aug 15 07:20:06 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:20:06 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:20:06 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:20:06 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:20:06 user nova-compute[72803]:   </clock>
Aug 15 07:20:06 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:20:06 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:20:06 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:20:06 user nova-compute[72803]:   </cpu>
Aug 15 07:20:06 user nova-compute[72803]:   <devices>
Aug 15 07:20:06 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:20:06 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:20:06 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk"/>
Aug 15 07:20:06 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:20:06 user nova-compute[72803]:     </disk>
Aug 15 07:20:06 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:20:06 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:20:06 user nova-compute[72803]:       <source dev="/dev/sdc"/>
Aug 15 07:20:06 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:20:06 user nova-compute[72803]:       <serial>45e3d123-2e90-4554-b6a0-10beb3462be6</serial>
Aug 15 07:20:06 user nova-compute[72803]:     </disk>
Aug 15 07:20:06 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:20:06 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:20:06 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.rescue"/>
Aug 15 07:20:06 user nova-compute[72803]:       <target dev="vdc" bus="virtio"/>
Aug 15 07:20:06 user nova-compute[72803]:       <boot order="1"/>
Aug 15 07:20:06 user nova-compute[72803]:     </disk>
Aug 15 07:20:06 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:20:06 user nova-compute[72803]:       <mac address="fa:16:3e:f0:3c:bc"/>
Aug 15 07:20:06 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:20:06 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:20:06 user nova-compute[72803]:       <target dev="tapf2cc6417-22"/>
Aug 15 07:20:06 user nova-compute[72803]:     </interface>
Aug 15 07:20:06 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:20:06 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/console.log" append="off"/>
Aug 15 07:20:06 user nova-compute[72803]:     </serial>
Aug 15 07:20:06 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:20:06 user nova-compute[72803]:     <video>
Aug 15 07:20:06 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:20:06 user nova-compute[72803]:     </video>
Aug 15 07:20:06 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:20:06 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:20:06 user nova-compute[72803]:     </rng>
Aug 15 07:20:06 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:20:06 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:20:06 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:20:06 user nova-compute[72803]:     </memballoon>
Aug 15 07:20:06 user nova-compute[72803]:   </devices>
Aug 15 07:20:06 user nova-compute[72803]: </domain>
Aug 15 07:20:06 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:20:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance destroyed successfully.
Aug 15 07:20:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:20:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:20:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:20:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] No VIF found with MAC fa:16:3e:f0:3c:bc, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:20:07 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:20:07 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Took 0.52 seconds to deallocate network for instance.
Aug 15 07:20:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-e23a7ce9-ef29-40c4-81d8-c39ae860ed45 req-aeb490d0-57a0-404e-a6c3-0c2b8cddffa9 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received event network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:20:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e23a7ce9-ef29-40c4-81d8-c39ae860ed45 req-aeb490d0-57a0-404e-a6c3-0c2b8cddffa9 service nova] Acquiring lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e23a7ce9-ef29-40c4-81d8-c39ae860ed45 req-aeb490d0-57a0-404e-a6c3-0c2b8cddffa9 service nova] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e23a7ce9-ef29-40c4-81d8-c39ae860ed45 req-aeb490d0-57a0-404e-a6c3-0c2b8cddffa9 service nova] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-e23a7ce9-ef29-40c4-81d8-c39ae860ed45 req-aeb490d0-57a0-404e-a6c3-0c2b8cddffa9 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] No waiting events found dispatching network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:20:07 user nova-compute[72803]: WARNING nova.compute.manager [req-e23a7ce9-ef29-40c4-81d8-c39ae860ed45 req-aeb490d0-57a0-404e-a6c3-0c2b8cddffa9 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received unexpected event network-vif-plugged-3f3146f8-bed2-4df2-9fda-31840234ca18 for instance with vm_state active and task_state deleting.
Aug 15 07:20:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-e23a7ce9-ef29-40c4-81d8-c39ae860ed45 req-aeb490d0-57a0-404e-a6c3-0c2b8cddffa9 service nova] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Received event network-vif-deleted-3f3146f8-bed2-4df2-9fda-31840234ca18 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:20:08 user nova-compute[72803]: INFO nova.compute.manager [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Took 0.84 seconds to detach 1 volumes for instance.
Aug 15 07:20:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Deleting volume: e70262c9-04cc-4d61-bfc8-02454bf3f306 {{(pid=72803) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:08 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Deleted allocations for instance 8f124c37-5cce-4021-bd16-bd01e676d19b
Aug 15 07:20:08 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692083993.6783044, 632fdd77-c7d3-493b-b8b2-e1a16296fdaa => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:20:08 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] VM Stopped (Lifecycle Event)
Aug 15 07:20:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1a096ead-193e-4b67-999c-3c002a283b22 None None] [instance: 632fdd77-c7d3-493b-b8b2-e1a16296fdaa] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c8984498-dcc0-47dc-aa34-c0b91c97f987 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "8f124c37-5cce-4021-bd16-bd01e676d19b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.399s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-522db2e3-b89a-4973-b758-aee84f925094 req-b9ed60c1-a45d-400e-82bd-e08b3507c012 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-522db2e3-b89a-4973-b758-aee84f925094 req-b9ed60c1-a45d-400e-82bd-e08b3507c012 service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-522db2e3-b89a-4973-b758-aee84f925094 req-b9ed60c1-a45d-400e-82bd-e08b3507c012 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-522db2e3-b89a-4973-b758-aee84f925094 req-b9ed60c1-a45d-400e-82bd-e08b3507c012 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:08 user nova-compute[72803]: DEBUG nova.compute.manager [req-522db2e3-b89a-4973-b758-aee84f925094 req-b9ed60c1-a45d-400e-82bd-e08b3507c012 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:20:08 user nova-compute[72803]: WARNING nova.compute.manager [req-522db2e3-b89a-4973-b758-aee84f925094 req-b9ed60c1-a45d-400e-82bd-e08b3507c012 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state active and task_state rescuing.
Aug 15 07:20:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for f9b55b06-8a65-4202-b494-f4261c872f62 due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:20:10 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084010.8846188, f9b55b06-8a65-4202-b494-f4261c872f62 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:20:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] VM Resumed (Lifecycle Event)
Aug 15 07:20:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b340a6a3-5a0e-46b2-b731-9d265cada071 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:20:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:20:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:20:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 07:20:10 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084010.8893235, f9b55b06-8a65-4202-b494-f4261c872f62 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:20:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] VM Started (Lifecycle Event)
Aug 15 07:20:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:20:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:20:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-b495b894-16f2-433a-b3ce-6afbe3a0cc9b req-c1bc9409-1c23-4ba3-8a97-d0d513c3f213 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:20:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b495b894-16f2-433a-b3ce-6afbe3a0cc9b req-c1bc9409-1c23-4ba3-8a97-d0d513c3f213 service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b495b894-16f2-433a-b3ce-6afbe3a0cc9b req-c1bc9409-1c23-4ba3-8a97-d0d513c3f213 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b495b894-16f2-433a-b3ce-6afbe3a0cc9b req-c1bc9409-1c23-4ba3-8a97-d0d513c3f213 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-b495b894-16f2-433a-b3ce-6afbe3a0cc9b req-c1bc9409-1c23-4ba3-8a97-d0d513c3f213 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:20:11 user nova-compute[72803]: WARNING nova.compute.manager [req-b495b894-16f2-433a-b3ce-6afbe3a0cc9b req-c1bc9409-1c23-4ba3-8a97-d0d513c3f213 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state rescued and task_state None.
Aug 15 07:20:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:16 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:21 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084006.2599328, 8f124c37-5cce-4021-bd16-bd01e676d19b => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:20:21 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] VM Stopped (Lifecycle Event)
Aug 15 07:20:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-958fc5ef-b839-4539-9d1a-f20993d32478 None None] [instance: 8f124c37-5cce-4021-bd16-bd01e676d19b] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:20:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:36 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:43 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:20:44 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:20:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:46 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:20:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:20:50 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:20:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:20:51 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:20:51 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:20:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:20:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:52 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:52 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:20:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:52 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:20:54 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:20:55 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:20:55 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8286MB free_disk=25.129596710205078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f9b55b06-8a65-4202-b494-f4261c872f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 89e22ae0-9706-4295-9fdd-97a09b012328 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:20:55 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:20:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:20:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:20:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:20:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:20:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:20:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:20:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updating instance_info_cache with network_info: [{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:20:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:20:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:20:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:20:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:21:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:21:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:21:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:21:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:21:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:21:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:21:16 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "26375ab8-3a94-45e6-b847-1d4d707a6450" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:17 user nova-compute[72803]: DEBUG nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:21:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:17 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:21:17 user nova-compute[72803]: INFO nova.compute.claims [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Claim successful on node user
Aug 15 07:21:18 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG nova.network.neutron [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:21:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:21:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:21:18 user nova-compute[72803]: INFO nova.virt.block_device [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Booting with volume 76825800-dd29-4ac2-ad92-1c5d8f03523f at /dev/vda
Aug 15 07:21:18 user nova-compute[72803]: DEBUG nova.policy [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '962292c4846b4ceab2cb00867135e136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9714fffd91c94d79aaa288d93fdfaffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG os_brick.utils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa40bc81-58b4-4779-834c-492efedd33a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a7ff2c-9ba2-4ab9-8ed5-fbb76e8e28e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[019fa60c-1cd2-48bb-93e5-af13d075f3fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc443a0-ebb4-4f95-8be1-3bb55df9befb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:21:18 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:21:18 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb538b7-25c5-40d2-8eea-f8a95b48e9ac]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG os_brick.utils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:21:18 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updating existing volume attachment record: c1f3eb3a-b64b-44b8-8af4-05bd7647e0b7 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG nova.network.neutron [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Successfully created port: 01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG nova.network.neutron [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Successfully updated port: 01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquired lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG nova.network.neutron [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-71fc3e58-e874-4cf3-983e-5d7d903967a1 req-940cfef2-e054-471a-a6a3-aa5af36c4cb2 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received event network-changed-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-71fc3e58-e874-4cf3-983e-5d7d903967a1 req-940cfef2-e054-471a-a6a3-aa5af36c4cb2 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Refreshing instance network info cache due to event network-changed-01998840-baea-46ef-a91e-8967cb8ad9ab. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71fc3e58-e874-4cf3-983e-5d7d903967a1 req-940cfef2-e054-471a-a6a3-aa5af36c4cb2 service nova] Acquiring lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:19 user nova-compute[72803]: DEBUG nova.network.neutron [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:21:20 user nova-compute[72803]: DEBUG nova.network.neutron [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updating instance_info_cache with network_info: [{"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Releasing lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Instance network_info: |[{"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:21:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71fc3e58-e874-4cf3-983e-5d7d903967a1 req-940cfef2-e054-471a-a6a3-aa5af36c4cb2 service nova] Acquired lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-71fc3e58-e874-4cf3-983e-5d7d903967a1 req-940cfef2-e054-471a-a6a3-aa5af36c4cb2 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Refreshing network info cache for port 01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:21:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-71fc3e58-e874-4cf3-983e-5d7d903967a1 req-940cfef2-e054-471a-a6a3-aa5af36c4cb2 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updated VIF entry in instance network info cache for port 01998840-baea-46ef-a91e-8967cb8ad9ab. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:21:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-71fc3e58-e874-4cf3-983e-5d7d903967a1 req-940cfef2-e054-471a-a6a3-aa5af36c4cb2 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updating instance_info_cache with network_info: [{"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71fc3e58-e874-4cf3-983e-5d7d903967a1 req-940cfef2-e054-471a-a6a3-aa5af36c4cb2 service nova] Releasing lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:21:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:21:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:21:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Creating image(s)
Aug 15 07:21:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Ensure instance console log exists: /opt/stack/data/nova/instances/26375ab8-3a94-45e6-b847-1d4d707a6450/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Start _get_guest_xml network_info=[{"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'c1f3eb3a-b64b-44b8-8af4-05bd7647e0b7', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHyqAUop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26375ab8-3a94-45e6-b847-1d4d707a6450', 'attached_at': '', 'detached_at': '', 'volume_id': '76825800-dd29-4ac2-ad92-1c5d8f03523f', 'serial': '76825800-dd29-4ac2-ad92-1c5d8f03523f'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:21:28 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:21:28 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHyqAUop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:21:28 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:21:28 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:21:28 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf208d7-b3dd-4c5a-87ab-466bf27f5ff0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:21:28 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c84dd17-d277-4001-baea-9e9340ed2b11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f] added
Aug 15 07:21:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c8a21-a34e-4f9a-9605-07525cd88b78]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ddd992-faa6-479b-8f19-f2749b5450d9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WHyqAUop {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WHyqAUop" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8113186-b614-4a89-9a9c-2ec477d16557]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WHyqAUop'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df5deba-f82b-4d53-9c38-e3783ade636d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aefa145-0830-4c2b-bb49-6ab3c9dcca27]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:21:28 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:21:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:21:28 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:21:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae8940f-a131-4f38-a90e-9cb48d969c24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f, portal: 172.16.0.220,3260]
Aug 15 07:21:28 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f, portal: 172.16.0.220,3260] successful.
Aug 15 07:21:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f6bd76-a369-48ed-81af-19be990f2088]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[25490400-f073-4eb6-b753-ea07083ef8e3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:21:28 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:21:28 user nova-compute[72803]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:21:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:21:28 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:21:28 user nova-compute[72803]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:21:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5ae3ac-6f3f-426b-8473-543e188158a4]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:21:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHyqAUop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26238303164346663', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238303164346663', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1133712799',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1133712799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1133712799',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrh47qtRNmSJ2v4pByrzK3gzjYGoatdFMEaSIpnFReY+ZiinG69sSpqvZas5Q2MYrDM0wDXnQzdJOvuhk/8FJhHQxVPrx8yN4JS1rEfo8GU0d/6SOytUbaX/z1tIhvIhg==',key_name='tempest-keypair-1472623624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-wt1dqvtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='962292c4846b4ceab2cb00867135e136',uuid=26375ab8-3a94-45e6-b847-1d4d707a6450,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:f5,bridge_name='br-int',has_traffic_filtering=True,id=01998840-baea-46ef-a91e-8967cb8ad9ab,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01998840-ba') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.objects.instance [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'pci_devices' on Instance uuid 26375ab8-3a94-45e6-b847-1d4d707a6450 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:21:29 user nova-compute[72803]:   <uuid>26375ab8-3a94-45e6-b847-1d4d707a6450</uuid>
Aug 15 07:21:29 user nova-compute[72803]:   <name>instance-0000002b</name>
Aug 15 07:21:29 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:21:29 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:21:29 user nova-compute[72803]:   <metadata>
Aug 15 07:21:29 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:21:29 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:21:29 user nova-compute[72803]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1133712799</nova:name>
Aug 15 07:21:29 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:21:28</nova:creationTime>
Aug 15 07:21:29 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:21:29 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:21:29 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:21:29 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:21:29 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:21:29 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:21:29 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:21:29 user nova-compute[72803]:       <nova:owner>
Aug 15 07:21:29 user nova-compute[72803]:         <nova:user uuid="962292c4846b4ceab2cb00867135e136">tempest-TestVolumeBootPattern-940544162-project-member</nova:user>
Aug 15 07:21:29 user nova-compute[72803]:         <nova:project uuid="9714fffd91c94d79aaa288d93fdfaffa">tempest-TestVolumeBootPattern-940544162</nova:project>
Aug 15 07:21:29 user nova-compute[72803]:       </nova:owner>
Aug 15 07:21:29 user nova-compute[72803]:       <nova:ports>
Aug 15 07:21:29 user nova-compute[72803]:         <nova:port uuid="01998840-baea-46ef-a91e-8967cb8ad9ab">
Aug 15 07:21:29 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 07:21:29 user nova-compute[72803]:         </nova:port>
Aug 15 07:21:29 user nova-compute[72803]:       </nova:ports>
Aug 15 07:21:29 user nova-compute[72803]:     </nova:instance>
Aug 15 07:21:29 user nova-compute[72803]:   </metadata>
Aug 15 07:21:29 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:21:29 user nova-compute[72803]:     <system>
Aug 15 07:21:29 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:21:29 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:21:29 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:21:29 user nova-compute[72803]:       <entry name="serial">26375ab8-3a94-45e6-b847-1d4d707a6450</entry>
Aug 15 07:21:29 user nova-compute[72803]:       <entry name="uuid">26375ab8-3a94-45e6-b847-1d4d707a6450</entry>
Aug 15 07:21:29 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:21:29 user nova-compute[72803]:     </system>
Aug 15 07:21:29 user nova-compute[72803]:   </sysinfo>
Aug 15 07:21:29 user nova-compute[72803]:   <os>
Aug 15 07:21:29 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:21:29 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:21:29 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:21:29 user nova-compute[72803]:   </os>
Aug 15 07:21:29 user nova-compute[72803]:   <features>
Aug 15 07:21:29 user nova-compute[72803]:     <acpi/>
Aug 15 07:21:29 user nova-compute[72803]:     <apic/>
Aug 15 07:21:29 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:21:29 user nova-compute[72803]:   </features>
Aug 15 07:21:29 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:21:29 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:21:29 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:21:29 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:21:29 user nova-compute[72803]:   </clock>
Aug 15 07:21:29 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:21:29 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:21:29 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:21:29 user nova-compute[72803]:   </cpu>
Aug 15 07:21:29 user nova-compute[72803]:   <devices>
Aug 15 07:21:29 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:21:29 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:21:29 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 07:21:29 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:21:29 user nova-compute[72803]:       <serial>76825800-dd29-4ac2-ad92-1c5d8f03523f</serial>
Aug 15 07:21:29 user nova-compute[72803]:     </disk>
Aug 15 07:21:29 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:21:29 user nova-compute[72803]:       <mac address="fa:16:3e:b6:86:f5"/>
Aug 15 07:21:29 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:21:29 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:21:29 user nova-compute[72803]:       <target dev="tap01998840-ba"/>
Aug 15 07:21:29 user nova-compute[72803]:     </interface>
Aug 15 07:21:29 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:21:29 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/26375ab8-3a94-45e6-b847-1d4d707a6450/console.log" append="off"/>
Aug 15 07:21:29 user nova-compute[72803]:     </serial>
Aug 15 07:21:29 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:21:29 user nova-compute[72803]:     <video>
Aug 15 07:21:29 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:21:29 user nova-compute[72803]:     </video>
Aug 15 07:21:29 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:21:29 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:21:29 user nova-compute[72803]:     </rng>
Aug 15 07:21:29 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:21:29 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:21:29 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:21:29 user nova-compute[72803]:     </memballoon>
Aug 15 07:21:29 user nova-compute[72803]:   </devices>
Aug 15 07:21:29 user nova-compute[72803]: </domain>
Aug 15 07:21:29 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1133712799',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1133712799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1133712799',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrh47qtRNmSJ2v4pByrzK3gzjYGoatdFMEaSIpnFReY+ZiinG69sSpqvZas5Q2MYrDM0wDXnQzdJOvuhk/8FJhHQxVPrx8yN4JS1rEfo8GU0d/6SOytUbaX/z1tIhvIhg==',key_name='tempest-keypair-1472623624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-wt1dqvtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='962292c4846b4ceab2cb00867135e136',uuid=26375ab8-3a94-45e6-b847-1d4d707a6450,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:f5,bridge_name='br-int',has_traffic_filtering=True,id=01998840-baea-46ef-a91e-8967cb8ad9ab,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01998840-ba') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG os_vif [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:f5,bridge_name='br-int',has_traffic_filtering=True,id=01998840-baea-46ef-a91e-8967cb8ad9ab,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01998840-ba') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01998840-ba, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01998840-ba, col_values=(('external_ids', {'iface-id': '01998840-baea-46ef-a91e-8967cb8ad9ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:86:f5', 'vm-uuid': '26375ab8-3a94-45e6-b847-1d4d707a6450'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:29 user nova-compute[72803]: INFO os_vif [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:86:f5,bridge_name='br-int',has_traffic_filtering=True,id=01998840-baea-46ef-a91e-8967cb8ad9ab,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01998840-ba')
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:21:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No VIF found with MAC fa:16:3e:b6:86:f5, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:21:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-5d057aee-b99f-4882-826e-d7a2b714981b req-2c0e0859-c505-4f2d-975b-f2aa0b369c9b service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received event network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5d057aee-b99f-4882-826e-d7a2b714981b req-2c0e0859-c505-4f2d-975b-f2aa0b369c9b service nova] Acquiring lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5d057aee-b99f-4882-826e-d7a2b714981b req-2c0e0859-c505-4f2d-975b-f2aa0b369c9b service nova] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5d057aee-b99f-4882-826e-d7a2b714981b req-2c0e0859-c505-4f2d-975b-f2aa0b369c9b service nova] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-5d057aee-b99f-4882-826e-d7a2b714981b req-2c0e0859-c505-4f2d-975b-f2aa0b369c9b service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] No waiting events found dispatching network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:21:31 user nova-compute[72803]: WARNING nova.compute.manager [req-5d057aee-b99f-4882-826e-d7a2b714981b req-2c0e0859-c505-4f2d-975b-f2aa0b369c9b service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received unexpected event network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab for instance with vm_state building and task_state spawning.
Aug 15 07:21:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:21:31 user nova-compute[72803]: INFO nova.compute.claims [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Claim successful on node user
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:21:31 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:21:31 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.policy [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cf4a499a9d54262bd8959b87918717c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa8ac0862d14e7792d6c03f46c170ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:21:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Creating image(s)
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk 1073741824" returned: 0 in 0.064s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Successfully created port: 067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Cannot resize image /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'migration_context' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084092.968033, 26375ab8-3a94-45e6-b847-1d4d707a6450 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:21:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] VM Resumed (Lifecycle Event)
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Ensure instance console log exists: /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Instance spawned successfully.
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:21:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:21:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084092.9682422, 26375ab8-3a94-45e6-b847-1d4d707a6450 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:21:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] VM Started (Lifecycle Event)
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:21:33 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:21:33 user nova-compute[72803]: INFO nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-c23fbf97-4bc6-4397-9461-b02e783c9400 req-15920525-cbec-4cdc-b6e6-65d3a3671c79 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received event network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c23fbf97-4bc6-4397-9461-b02e783c9400 req-15920525-cbec-4cdc-b6e6-65d3a3671c79 service nova] Acquiring lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c23fbf97-4bc6-4397-9461-b02e783c9400 req-15920525-cbec-4cdc-b6e6-65d3a3671c79 service nova] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c23fbf97-4bc6-4397-9461-b02e783c9400 req-15920525-cbec-4cdc-b6e6-65d3a3671c79 service nova] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-c23fbf97-4bc6-4397-9461-b02e783c9400 req-15920525-cbec-4cdc-b6e6-65d3a3671c79 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] No waiting events found dispatching network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:21:33 user nova-compute[72803]: WARNING nova.compute.manager [req-c23fbf97-4bc6-4397-9461-b02e783c9400 req-15920525-cbec-4cdc-b6e6-65d3a3671c79 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received unexpected event network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab for instance with vm_state building and task_state spawning.
Aug 15 07:21:33 user nova-compute[72803]: INFO nova.compute.manager [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Took 15.32 seconds to build instance.
Aug 15 07:21:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-751d9d3a-3b06-4ff3-b933-924e728768d8 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.409s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Successfully updated port: 067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquired lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.network.neutron [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Releasing lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance network_info: |[{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Start _get_guest_xml network_info=[{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:21:33 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:21:33 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-218054654',display_name='tempest-ServerRescueNegativeTestJSON-server-218054654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-218054654',id=44,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQoL7M/7lnh5ItsBC6ALybOX/qAelb5zwvWOrtJfhGWPzbxUVb8Z044Dfm1/KTq1HuH+P/Zt8jQNokZ+L/cPHpZ+AR8Swrzeg15f6ft03NqW1hZRn+lz8vFgJfj10yUzg==',key_name='tempest-keypair-775720222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-vjnaaghm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:21:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cf4a499a9d54262bd8959b87918717c',uuid=4689e7e1-47e5-435f-b0f2-32327f955285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:3e,bridge_name='br-int',has_traffic_filtering=True,id=067aa359-e89d-413f-b75e-54e39ef2d8c0,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067aa359-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:21:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'pci_devices' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:21:34 user nova-compute[72803]:   <uuid>4689e7e1-47e5-435f-b0f2-32327f955285</uuid>
Aug 15 07:21:34 user nova-compute[72803]:   <name>instance-0000002c</name>
Aug 15 07:21:34 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:21:34 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:21:34 user nova-compute[72803]:   <metadata>
Aug 15 07:21:34 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:21:34 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:21:34 user nova-compute[72803]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-218054654</nova:name>
Aug 15 07:21:34 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:21:33</nova:creationTime>
Aug 15 07:21:34 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:21:34 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:21:34 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:21:34 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:21:34 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:21:34 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:21:34 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:21:34 user nova-compute[72803]:       <nova:owner>
Aug 15 07:21:34 user nova-compute[72803]:         <nova:user uuid="0cf4a499a9d54262bd8959b87918717c">tempest-ServerRescueNegativeTestJSON-1974019782-project-member</nova:user>
Aug 15 07:21:34 user nova-compute[72803]:         <nova:project uuid="eaa8ac0862d14e7792d6c03f46c170ba">tempest-ServerRescueNegativeTestJSON-1974019782</nova:project>
Aug 15 07:21:34 user nova-compute[72803]:       </nova:owner>
Aug 15 07:21:34 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:21:34 user nova-compute[72803]:       <nova:ports>
Aug 15 07:21:34 user nova-compute[72803]:         <nova:port uuid="067aa359-e89d-413f-b75e-54e39ef2d8c0">
Aug 15 07:21:34 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 07:21:34 user nova-compute[72803]:         </nova:port>
Aug 15 07:21:34 user nova-compute[72803]:       </nova:ports>
Aug 15 07:21:34 user nova-compute[72803]:     </nova:instance>
Aug 15 07:21:34 user nova-compute[72803]:   </metadata>
Aug 15 07:21:34 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:21:34 user nova-compute[72803]:     <system>
Aug 15 07:21:34 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:21:34 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:21:34 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:21:34 user nova-compute[72803]:       <entry name="serial">4689e7e1-47e5-435f-b0f2-32327f955285</entry>
Aug 15 07:21:34 user nova-compute[72803]:       <entry name="uuid">4689e7e1-47e5-435f-b0f2-32327f955285</entry>
Aug 15 07:21:34 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:21:34 user nova-compute[72803]:     </system>
Aug 15 07:21:34 user nova-compute[72803]:   </sysinfo>
Aug 15 07:21:34 user nova-compute[72803]:   <os>
Aug 15 07:21:34 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:21:34 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:21:34 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:21:34 user nova-compute[72803]:   </os>
Aug 15 07:21:34 user nova-compute[72803]:   <features>
Aug 15 07:21:34 user nova-compute[72803]:     <acpi/>
Aug 15 07:21:34 user nova-compute[72803]:     <apic/>
Aug 15 07:21:34 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:21:34 user nova-compute[72803]:   </features>
Aug 15 07:21:34 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:21:34 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:21:34 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:21:34 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:21:34 user nova-compute[72803]:   </clock>
Aug 15 07:21:34 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:21:34 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:21:34 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:21:34 user nova-compute[72803]:   </cpu>
Aug 15 07:21:34 user nova-compute[72803]:   <devices>
Aug 15 07:21:34 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:21:34 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:21:34 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk"/>
Aug 15 07:21:34 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:21:34 user nova-compute[72803]:     </disk>
Aug 15 07:21:34 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:21:34 user nova-compute[72803]:       <mac address="fa:16:3e:af:99:3e"/>
Aug 15 07:21:34 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:21:34 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:21:34 user nova-compute[72803]:       <target dev="tap067aa359-e8"/>
Aug 15 07:21:34 user nova-compute[72803]:     </interface>
Aug 15 07:21:34 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:21:34 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/console.log" append="off"/>
Aug 15 07:21:34 user nova-compute[72803]:     </serial>
Aug 15 07:21:34 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:21:34 user nova-compute[72803]:     <video>
Aug 15 07:21:34 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:21:34 user nova-compute[72803]:     </video>
Aug 15 07:21:34 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:21:34 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:21:34 user nova-compute[72803]:     </rng>
Aug 15 07:21:34 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:21:34 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:21:34 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:21:34 user nova-compute[72803]:     </memballoon>
Aug 15 07:21:34 user nova-compute[72803]:   </devices>
Aug 15 07:21:34 user nova-compute[72803]: </domain>
Aug 15 07:21:34 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-218054654',display_name='tempest-ServerRescueNegativeTestJSON-server-218054654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-218054654',id=44,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQoL7M/7lnh5ItsBC6ALybOX/qAelb5zwvWOrtJfhGWPzbxUVb8Z044Dfm1/KTq1HuH+P/Zt8jQNokZ+L/cPHpZ+AR8Swrzeg15f6ft03NqW1hZRn+lz8vFgJfj10yUzg==',key_name='tempest-keypair-775720222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-vjnaaghm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:21:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cf4a499a9d54262bd8959b87918717c',uuid=4689e7e1-47e5-435f-b0f2-32327f955285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:3e,bridge_name='br-int',has_traffic_filtering=True,id=067aa359-e89d-413f-b75e-54e39ef2d8c0,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067aa359-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG os_vif [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:3e,bridge_name='br-int',has_traffic_filtering=True,id=067aa359-e89d-413f-b75e-54e39ef2d8c0,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067aa359-e8') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap067aa359-e8, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap067aa359-e8, col_values=(('external_ids', {'iface-id': '067aa359-e89d-413f-b75e-54e39ef2d8c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:99:3e', 'vm-uuid': '4689e7e1-47e5-435f-b0f2-32327f955285'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:34 user nova-compute[72803]: INFO os_vif [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:99:3e,bridge_name='br-int',has_traffic_filtering=True,id=067aa359-e89d-413f-b75e-54e39ef2d8c0,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067aa359-e8')
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No VIF found with MAC fa:16:3e:af:99:3e, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-f2f4908e-38d7-454d-ad78-318787e1a067 req-4c415dc7-6868-47f3-913e-0ae04569ea96 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-f2f4908e-38d7-454d-ad78-318787e1a067 req-4c415dc7-6868-47f3-913e-0ae04569ea96 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing instance network info cache due to event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2f4908e-38d7-454d-ad78-318787e1a067 req-4c415dc7-6868-47f3-913e-0ae04569ea96 service nova] Acquiring lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2f4908e-38d7-454d-ad78-318787e1a067 req-4c415dc7-6868-47f3-913e-0ae04569ea96 service nova] Acquired lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.network.neutron [req-f2f4908e-38d7-454d-ad78-318787e1a067 req-4c415dc7-6868-47f3-913e-0ae04569ea96 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.network.neutron [req-f2f4908e-38d7-454d-ad78-318787e1a067 req-4c415dc7-6868-47f3-913e-0ae04569ea96 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updated VIF entry in instance network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG nova.network.neutron [req-f2f4908e-38d7-454d-ad78-318787e1a067 req-4c415dc7-6868-47f3-913e-0ae04569ea96 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating instance_info_cache with network_info: [{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f2f4908e-38d7-454d-ad78-318787e1a067 req-4c415dc7-6868-47f3-913e-0ae04569ea96 service nova] Releasing lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-0c66638d-0064-45e0-9f20-6f3dca6f3c5f req-11a774af-634a-4ba1-a216-6c5ec3944277 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-changed-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG nova.compute.manager [req-0c66638d-0064-45e0-9f20-6f3dca6f3c5f req-11a774af-634a-4ba1-a216-6c5ec3944277 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Refreshing instance network info cache due to event network-changed-067aa359-e89d-413f-b75e-54e39ef2d8c0. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0c66638d-0064-45e0-9f20-6f3dca6f3c5f req-11a774af-634a-4ba1-a216-6c5ec3944277 service nova] Acquiring lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0c66638d-0064-45e0-9f20-6f3dca6f3c5f req-11a774af-634a-4ba1-a216-6c5ec3944277 service nova] Acquired lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG nova.network.neutron [req-0c66638d-0064-45e0-9f20-6f3dca6f3c5f req-11a774af-634a-4ba1-a216-6c5ec3944277 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Refreshing network info cache for port 067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:35 user nova-compute[72803]: INFO nova.compute.manager [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Detaching volume 3df9620a-4f01-463e-947e-477db998e0f1
Aug 15 07:21:35 user nova-compute[72803]: INFO nova.virt.block_device [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Attempting to driver detach volume 3df9620a-4f01-463e-947e-477db998e0f1 from mountpoint /dev/vdb
Aug 15 07:21:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Attempting to detach device vdb from instance 89e22ae0-9706-4295-9fdd-97a09b012328 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:21:35 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:21:35 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:21:35 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:21:35 user nova-compute[72803]:   <serial>3df9620a-4f01-463e-947e-477db998e0f1</serial>
Aug 15 07:21:35 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 07:21:35 user nova-compute[72803]: </disk>
Aug 15 07:21:35 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:35 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully detached device vdb from instance 89e22ae0-9706-4295-9fdd-97a09b012328 from the persistent domain config.
Aug 15 07:21:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89e22ae0-9706-4295-9fdd-97a09b012328 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:21:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:21:35 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:21:35 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:21:35 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:21:35 user nova-compute[72803]:   <serial>3df9620a-4f01-463e-947e-477db998e0f1</serial>
Aug 15 07:21:35 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 07:21:35 user nova-compute[72803]: </disk>
Aug 15 07:21:35 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.network.neutron [req-0c66638d-0064-45e0-9f20-6f3dca6f3c5f req-11a774af-634a-4ba1-a216-6c5ec3944277 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updated VIF entry in instance network info cache for port 067aa359-e89d-413f-b75e-54e39ef2d8c0. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.network.neutron [req-0c66638d-0064-45e0-9f20-6f3dca6f3c5f req-11a774af-634a-4ba1-a216-6c5ec3944277 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0c66638d-0064-45e0-9f20-6f3dca6f3c5f req-11a774af-634a-4ba1-a216-6c5ec3944277 service nova] Releasing lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692084096.2594268, 89e22ae0-9706-4295-9fdd-97a09b012328 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:21:36 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully detached device vdb from instance 89e22ae0-9706-4295-9fdd-97a09b012328 from the live domain config.
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdVMZnsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:21:36 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76cbbf2-1678-440d-88b6-f8a3e04bf9bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[390ec9d4-da3a-4c2a-b87c-6664d16e9be0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:21:36 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:21:36 user nova-compute[72803]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:21:36 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 (non-flash)
Aug 15 07:21:36 user nova-compute[72803]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:21:36 user nova-compute[72803]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:21:36 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e0605fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4149931-48e2-4a6a-a31f-3dc13737b881]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a704c3-00c6-46a7-89c1-7b8b01f0aa84]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing instance network info cache due to event network-changed-ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] Acquiring lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] Acquired lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.network.neutron [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Refreshing network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[18789507-c145-4499-b217-1bd39597e106]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcd139b-737f-4296-ad0d-290364fe4fb3]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced7eb6-0734-443d-8495-7523d18c8d94]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a04c5e-2a26-4838-80d8-94be917c8f2b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260]
Aug 15 07:21:36 user nova-compute[72803]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1, portal: 172.16.0.220,3260] successful.
Aug 15 07:21:36 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3df9620a-4f01-463e-947e-477db998e0f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5467f1bd-56e9-48d6-8845-155496a6cd38]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] <== disconnect_volume: return (339ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:21:36 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.network.neutron [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updated VIF entry in instance network info cache for port ca02489e-f336-4167-97a6-cf56edc6c64b. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.network.neutron [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating instance_info_cache with network_info: [{"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] Releasing lock "refresh_cache-89e22ae0-9706-4295-9fdd-97a09b012328" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:21:37 user nova-compute[72803]: WARNING nova.compute.manager [req-ab698698-3413-4163-9bb4-6fb944d8b38a req-ab53203f-4756-4a41-9878-83c012f8e283 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state building and task_state spawning.
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.objects.instance [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'flavor' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4f65b1f8-a0c1-456f-874d-8ce6eed09083 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.884s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084097.7369046, 4689e7e1-47e5-435f-b0f2-32327f955285 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:21:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] VM Resumed (Lifecycle Event)
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:21:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance spawned successfully.
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:21:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084097.74028, 4689e7e1-47e5-435f-b0f2-32327f955285 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:21:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] VM Started (Lifecycle Event)
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:21:37 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:21:37 user nova-compute[72803]: INFO nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 15 07:21:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:37 user nova-compute[72803]: INFO nova.compute.manager [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Took 6.36 seconds to build instance.
Aug 15 07:21:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d8483abc-2e2a-4972-8011-6caa31aeee0b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.455s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:38 user nova-compute[72803]: DEBUG nova.compute.manager [req-cea6fafc-cb74-4316-aa1c-dcebc898c5b7 req-863b24a9-cbe9-499b-b2eb-80295d56b711 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cea6fafc-cb74-4316-aa1c-dcebc898c5b7 req-863b24a9-cbe9-499b-b2eb-80295d56b711 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cea6fafc-cb74-4316-aa1c-dcebc898c5b7 req-863b24a9-cbe9-499b-b2eb-80295d56b711 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-cea6fafc-cb74-4316-aa1c-dcebc898c5b7 req-863b24a9-cbe9-499b-b2eb-80295d56b711 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:38 user nova-compute[72803]: DEBUG nova.compute.manager [req-cea6fafc-cb74-4316-aa1c-dcebc898c5b7 req-863b24a9-cbe9-499b-b2eb-80295d56b711 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:21:38 user nova-compute[72803]: WARNING nova.compute.manager [req-cea6fafc-cb74-4316-aa1c-dcebc898c5b7 req-863b24a9-cbe9-499b-b2eb-80295d56b711 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state None.
Aug 15 07:21:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:45 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:21:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:21:47 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:21:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:21:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:50 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:21:50 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:21:51 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:21:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:21:53 user nova-compute[72803]: INFO nova.compute.manager [None req-f2cc8ae6-2915-493c-8d88-813dadcde34c tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Unrescuing
Aug 15 07:21:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2cc8ae6-2915-493c-8d88-813dadcde34c tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2cc8ae6-2915-493c-8d88-813dadcde34c tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquired lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:53 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f2cc8ae6-2915-493c-8d88-813dadcde34c tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG nova.network.neutron [None req-f2cc8ae6-2915-493c-8d88-813dadcde34c tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2cc8ae6-2915-493c-8d88-813dadcde34c tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Releasing lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f2cc8ae6-2915-493c-8d88-813dadcde34c tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'flavor' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-b1a60685-6702-4fda-bbed-0f718899e3c6 req-64d26f4c-a95b-4040-a695-886fd9c666b2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b1a60685-6702-4fda-bbed-0f718899e3c6 req-64d26f4c-a95b-4040-a695-886fd9c666b2 service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b1a60685-6702-4fda-bbed-0f718899e3c6 req-64d26f4c-a95b-4040-a695-886fd9c666b2 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b1a60685-6702-4fda-bbed-0f718899e3c6 req-64d26f4c-a95b-4040-a695-886fd9c666b2 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-b1a60685-6702-4fda-bbed-0f718899e3c6 req-64d26f4c-a95b-4040-a695-886fd9c666b2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:21:54 user nova-compute[72803]: WARNING nova.compute.manager [req-b1a60685-6702-4fda-bbed-0f718899e3c6 req-64d26f4c-a95b-4040-a695-886fd9c666b2 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:21:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance destroyed successfully.
Aug 15 07:21:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:21:56 user nova-compute[72803]: WARNING nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:21:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-changed-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Refreshing instance network info cache due to event network-changed-f2cc6417-2234-4954-b1a8-d51f14da390f. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Acquiring lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Acquired lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:56 user nova-compute[72803]: DEBUG nova.network.neutron [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Refreshing network info cache for port f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updated VIF entry in instance network info cache for port f2cc6417-2234-4954-b1a8-d51f14da390f. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Releasing lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-changed-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Refreshing instance network info cache due to event network-changed-f2cc6417-2234-4954-b1a8-d51f14da390f. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Acquiring lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Acquired lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Refreshing network info cache for port f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updated VIF entry in instance network info cache for port f2cc6417-2234-4954-b1a8-d51f14da390f. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Releasing lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:21:58 user nova-compute[72803]: WARNING nova.compute.manager [req-4c456e16-c95a-4fe5-b496-ca8eff0e88e5 req-41543e91-7d39-47c1-a709-7f1c25985c24 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for f9b55b06-8a65-4202-b494-f4261c872f62 due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:21:58 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084118.980103, f9b55b06-8a65-4202-b494-f4261c872f62 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:21:58 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] VM Resumed (Lifecycle Event)
Aug 15 07:21:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f2cc8ae6-2915-493c-8d88-813dadcde34c tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-ef5aea13-3991-43da-96df-85d95ac4742d req-17bcb741-dfd9-4e25-ac44-9be3906dbdee service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ef5aea13-3991-43da-96df-85d95ac4742d req-17bcb741-dfd9-4e25-ac44-9be3906dbdee service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ef5aea13-3991-43da-96df-85d95ac4742d req-17bcb741-dfd9-4e25-ac44-9be3906dbdee service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ef5aea13-3991-43da-96df-85d95ac4742d req-17bcb741-dfd9-4e25-ac44-9be3906dbdee service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-ef5aea13-3991-43da-96df-85d95ac4742d req-17bcb741-dfd9-4e25-ac44-9be3906dbdee service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:21:59 user nova-compute[72803]: WARNING nova.compute.manager [req-ef5aea13-3991-43da-96df-85d95ac4742d req-17bcb741-dfd9-4e25-ac44-9be3906dbdee service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:21:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:21:59 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 07:21:59 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084118.992629, f9b55b06-8a65-4202-b494-f4261c872f62 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:21:59 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] VM Started (Lifecycle Event)
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:21:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:00 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:22:00 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=25.090492248535156GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f9b55b06-8a65-4202-b494-f4261c872f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 89e22ae0-9706-4295-9fdd-97a09b012328 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 26375ab8-3a94-45e6-b847-1d4d707a6450 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4689e7e1-47e5-435f-b0f2-32327f955285 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:22:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:22:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:22:01 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:22:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [{"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:22:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-f9b55b06-8a65-4202-b494-f4261c872f62" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:22:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:22:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:22:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:22:03 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:22:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:27 user nova-compute[72803]: INFO nova.compute.manager [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Detaching volume 45e3d123-2e90-4554-b6a0-10beb3462be6
Aug 15 07:22:27 user nova-compute[72803]: INFO nova.virt.block_device [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Attempting to driver detach volume 45e3d123-2e90-4554-b6a0-10beb3462be6 from mountpoint /dev/vdb
Aug 15 07:22:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Attempting to detach device vdb from instance f9b55b06-8a65-4202-b494-f4261c872f62 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:22:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:22:27 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:22:27 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:22:27 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:22:27 user nova-compute[72803]:   <serial>45e3d123-2e90-4554-b6a0-10beb3462be6</serial>
Aug 15 07:22:27 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:22:27 user nova-compute[72803]: </disk>
Aug 15 07:22:27 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:22:27 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Successfully detached device vdb from instance f9b55b06-8a65-4202-b494-f4261c872f62 from the persistent domain config.
Aug 15 07:22:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9b55b06-8a65-4202-b494-f4261c872f62 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:22:27 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:22:27 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:22:27 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:22:27 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:22:27 user nova-compute[72803]:   <serial>45e3d123-2e90-4554-b6a0-10beb3462be6</serial>
Aug 15 07:22:27 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:22:27 user nova-compute[72803]: </disk>
Aug 15 07:22:27 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692084148.0506227, f9b55b06-8a65-4202-b494-f4261c872f62 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:22:28 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Successfully detached device vdb from instance f9b55b06-8a65-4202-b494-f4261c872f62 from the live domain config.
Aug 15 07:22:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEMUXkAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:22:28 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a496e668-6406-44ff-898d-27093a0025d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d253e5cb-3966-465d-962d-0177c0aa4084]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:22:28 user nova-compute[72803]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:22:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 (non-flash)
Aug 15 07:22:28 user nova-compute[72803]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:22:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c05b70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6694dc2-6837-4a08-8dce-c2ebdf7f1d58]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[802882b5-2ea4-443e-ac08-b908f7fb0160]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[714727e9-f043-4ecf-9107-fb048b0aa6a2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cd4d50-fb96-4431-b165-8a422da42e3e]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc4cf17-b1fe-4001-90f4-034bf9f00809]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5089706d-3ab2-4ab2-82fc-eec962512261]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6, portal: 172.16.0.220,3260]
Aug 15 07:22:28 user nova-compute[72803]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6, portal: 172.16.0.220,3260] successful.
Aug 15 07:22:28 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e3d123-2e90-4554-b6a0-10beb3462be6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e2474d-83f1-4903-95fe-11924102c60d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] <== disconnect_volume: return (296ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:22:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:22:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:29 user nova-compute[72803]: DEBUG nova.objects.instance [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'flavor' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:22:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-fd2690cf-c2bc-4dbc-9a46-55a048bbb0e6 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:31 user nova-compute[72803]: INFO nova.compute.manager [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Terminating instance
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_power_states {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-171d7f74-ddbb-4774-b9d5-546e2c5e0f80 req-c81d3617-1697-46f1-b9e9-a1d2a28273d8 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-171d7f74-ddbb-4774-b9d5-546e2c5e0f80 req-c81d3617-1697-46f1-b9e9-a1d2a28273d8 service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-171d7f74-ddbb-4774-b9d5-546e2c5e0f80 req-c81d3617-1697-46f1-b9e9-a1d2a28273d8 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-171d7f74-ddbb-4774-b9d5-546e2c5e0f80 req-c81d3617-1697-46f1-b9e9-a1d2a28273d8 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-171d7f74-ddbb-4774-b9d5-546e2c5e0f80 req-c81d3617-1697-46f1-b9e9-a1d2a28273d8 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-171d7f74-ddbb-4774-b9d5-546e2c5e0f80 req-c81d3617-1697-46f1-b9e9-a1d2a28273d8 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 26375ab8-3a94-45e6-b847-1d4d707a6450 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "39617700-3648-4f38-b129-0c71584828c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "26375ab8-3a94-45e6-b847-1d4d707a6450" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "39617700-3648-4f38-b129-0c71584828c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Instance destroyed successfully.
Aug 15 07:22:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'resources' on Instance uuid 89e22ae0-9706-4295-9fdd-97a09b012328 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-776555605',display_name='tempest-TestMinimumBasicScenario-server-776555605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-776555605',id=41,image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkG8deH+MspIOuSTtsx7S1v+ajnEtABiOWhmo6nYo6CQk5ilKRcV2ltjjvsnm6cm29/DmQyRETgiOoGbj5JLHScL/pb0/Q9tSENW0qlMy6o5W3IpjeOJplFowBjoQlvlw==',key_name='tempest-TestMinimumBasicScenario-1926102892',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-8qtgi0gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5761c4c-071a-4d72-938b-be1925849dcd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:19:49Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=89e22ae0-9706-4295-9fdd-97a09b012328,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "ca02489e-f336-4167-97a6-cf56edc6c64b", "address": "fa:16:3e:1b:1a:49", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca02489e-f3", "ovs_interfaceid": "ca02489e-f336-4167-97a6-cf56edc6c64b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG os_vif [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca02489e-f3, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: INFO os_vif [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:1a:49,bridge_name='br-int',has_traffic_filtering=True,id=ca02489e-f336-4167-97a6-cf56edc6c64b,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca02489e-f3')
Aug 15 07:22:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Deleting instance files /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328_del
Aug 15 07:22:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Deletion of /opt/stack/data/nova/instances/89e22ae0-9706-4295-9fdd-97a09b012328_del complete
Aug 15 07:22:32 user nova-compute[72803]: INFO nova.compute.manager [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 07:22:32 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:22:33 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Took 0.75 seconds to deallocate network for instance.
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-d1154c3b-6617-4635-9556-cd7e3c172dd1 req-80c182be-775f-469b-898b-a937be426fdd service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-deleted-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:33 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Deleted allocations for instance 89e22ae0-9706-4295-9fdd-97a09b012328
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b67f426-cf8b-487e-8762-5950af931f18 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.745s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:33 user nova-compute[72803]: INFO nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "89e22ae0-9706-4295-9fdd-97a09b012328" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:22:33 user nova-compute[72803]: WARNING nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state deleted and task_state None.
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:22:33 user nova-compute[72803]: WARNING nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state deleted and task_state None.
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:22:33 user nova-compute[72803]: WARNING nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state deleted and task_state None.
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:22:33 user nova-compute[72803]: WARNING nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-unplugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state deleted and task_state None.
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Acquiring lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] Lock "89e22ae0-9706-4295-9fdd-97a09b012328-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] No waiting events found dispatching network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:22:33 user nova-compute[72803]: WARNING nova.compute.manager [req-1beb2367-f0d0-4af0-865f-4b5b1851251f req-5e7e0862-ce36-4bba-ab45-978eb5bb51c5 service nova] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Received unexpected event network-vif-plugged-ca02489e-f336-4167-97a6-cf56edc6c64b for instance with vm_state deleted and task_state None.
Aug 15 07:22:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:22:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:22:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:22:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:22:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:22:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:46 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:47 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084152.35751, 89e22ae0-9706-4295-9fdd-97a09b012328 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:22:47 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] VM Stopped (Lifecycle Event)
Aug 15 07:22:47 user nova-compute[72803]: DEBUG nova.compute.manager [None req-a5baa0e6-c5a8-4384-b28f-d86c9b73a429 None None] [instance: 89e22ae0-9706-4295-9fdd-97a09b012328] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:22:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:22:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:22:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:22:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:22:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:22:47 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:51 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:22:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:22:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:22:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:22:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:22:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:22:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:22:58 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:22:58 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:22:58 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8242MB free_disk=25.115863800048828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:22:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:22:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance f9b55b06-8a65-4202-b494-f4261c872f62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 26375ab8-3a94-45e6-b847-1d4d707a6450 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4689e7e1-47e5-435f-b0f2-32327f955285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:22:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:23:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:23:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:23:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:23:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:23:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:23:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:23:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:23:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:23:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:23:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:23:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-0ee460ce-33bd-4e2c-9576-1457efad2566 req-5117cb26-a8ef-43f1-8aa5-79f5e96b8505 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received event network-changed-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-0ee460ce-33bd-4e2c-9576-1457efad2566 req-5117cb26-a8ef-43f1-8aa5-79f5e96b8505 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Refreshing instance network info cache due to event network-changed-01998840-baea-46ef-a91e-8967cb8ad9ab. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0ee460ce-33bd-4e2c-9576-1457efad2566 req-5117cb26-a8ef-43f1-8aa5-79f5e96b8505 service nova] Acquiring lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0ee460ce-33bd-4e2c-9576-1457efad2566 req-5117cb26-a8ef-43f1-8aa5-79f5e96b8505 service nova] Acquired lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-0ee460ce-33bd-4e2c-9576-1457efad2566 req-5117cb26-a8ef-43f1-8aa5-79f5e96b8505 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Refreshing network info cache for port 01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-0ee460ce-33bd-4e2c-9576-1457efad2566 req-5117cb26-a8ef-43f1-8aa5-79f5e96b8505 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updated VIF entry in instance network info cache for port 01998840-baea-46ef-a91e-8967cb8ad9ab. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-0ee460ce-33bd-4e2c-9576-1457efad2566 req-5117cb26-a8ef-43f1-8aa5-79f5e96b8505 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updating instance_info_cache with network_info: [{"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0ee460ce-33bd-4e2c-9576-1457efad2566 req-5117cb26-a8ef-43f1-8aa5-79f5e96b8505 service nova] Releasing lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:23:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:18 user nova-compute[72803]: INFO nova.compute.manager [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Terminating instance
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-05037d0f-6502-44bb-992e-90d0f572d651 req-c578b9c9-ca23-4700-9eb1-6cb3c816647d service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-05037d0f-6502-44bb-992e-90d0f572d651 req-c578b9c9-ca23-4700-9eb1-6cb3c816647d service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-05037d0f-6502-44bb-992e-90d0f572d651 req-c578b9c9-ca23-4700-9eb1-6cb3c816647d service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-05037d0f-6502-44bb-992e-90d0f572d651 req-c578b9c9-ca23-4700-9eb1-6cb3c816647d service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-05037d0f-6502-44bb-992e-90d0f572d651 req-c578b9c9-ca23-4700-9eb1-6cb3c816647d service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.compute.manager [req-05037d0f-6502-44bb-992e-90d0f572d651 req-c578b9c9-ca23-4700-9eb1-6cb3c816647d service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-unplugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Instance destroyed successfully.
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.objects.instance [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lazy-loading 'resources' on Instance uuid f9b55b06-8a65-4202-b494-f4261c872f62 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2114399517',display_name='tempest-ServerStableDeviceRescueTest-server-2114399517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2114399517',id=39,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH3mRkT28QKSLpSuGqX9AbaFPnxcddlyqDTSGZ9EFwfhLJPio+bIowVDYW2fMsqSTRbt/7DHWSCvTNsOd68YHCEGyZujDOlZntS5tJ4k2VXhpBokRvJxeGYOLUESSDlvg==',key_name='tempest-keypair-1111085751',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee2fb93a370a4fa0badb369280adb602',ramdisk_id='',reservation_id='r-6iw9rbgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-473594700',owner_user_name='tempest-ServerStableDeviceRescueTest-473594700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:21:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580a8d3496704b25b33f67cfb21e6d5b',uuid=f9b55b06-8a65-4202-b494-f4261c872f62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Converting VIF {"id": "f2cc6417-2234-4954-b1a8-d51f14da390f", "address": "fa:16:3e:f0:3c:bc", "network": {"id": "6192a07b-dedb-4cf9-8538-7c722b450542", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1898094832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2fb93a370a4fa0badb369280adb602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cc6417-22", "ovs_interfaceid": "f2cc6417-2234-4954-b1a8-d51f14da390f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2cc6417-2234-4954-b1a8-d51f14da390f,network=Network(6192a07b-dedb-4cf9-8538-7c722b450542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cc6417-22') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG os_vif [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2cc6417-2234-4954-b1a8-d51f14da390f,network=Network(6192a07b-dedb-4cf9-8538-7c722b450542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cc6417-22') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2cc6417-22, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:23:18 user nova-compute[72803]: INFO os_vif [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=f2cc6417-2234-4954-b1a8-d51f14da390f,network=Network(6192a07b-dedb-4cf9-8538-7c722b450542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cc6417-22')
Aug 15 07:23:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Deleting instance files /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62_del
Aug 15 07:23:18 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Deletion of /opt/stack/data/nova/instances/f9b55b06-8a65-4202-b494-f4261c872f62_del complete
Aug 15 07:23:18 user nova-compute[72803]: INFO nova.compute.manager [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 07:23:18 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:23:18 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:23:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:20 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Took 1.30 seconds to deallocate network for instance.
Aug 15 07:23:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-fd3ee133-d0fa-42a2-a725-0861e01e1c28 req-58caf006-5c5d-4e32-a85d-c64c76949b57 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-deleted-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:20 user nova-compute[72803]: INFO nova.compute.manager [req-fd3ee133-d0fa-42a2-a725-0861e01e1c28 req-58caf006-5c5d-4e32-a85d-c64c76949b57 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Neutron deleted interface f2cc6417-2234-4954-b1a8-d51f14da390f; detaching it from the instance and deleting it from the info cache
Aug 15 07:23:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-fd3ee133-d0fa-42a2-a725-0861e01e1c28 req-58caf006-5c5d-4e32-a85d-c64c76949b57 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-fd3ee133-d0fa-42a2-a725-0861e01e1c28 req-58caf006-5c5d-4e32-a85d-c64c76949b57 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Detach interface failed, port_id=f2cc6417-2234-4954-b1a8-d51f14da390f, reason: Instance f9b55b06-8a65-4202-b494-f4261c872f62 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:20 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Deleted allocations for instance f9b55b06-8a65-4202-b494-f4261c872f62
Aug 15 07:23:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6f1026-a07f-4ac2-8b84-248ac6850ea2 tempest-ServerStableDeviceRescueTest-473594700 tempest-ServerStableDeviceRescueTest-473594700-project-member] Lock "f9b55b06-8a65-4202-b494-f4261c872f62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-7915a1bc-614d-4ed8-a26c-40984ebc4c15 req-330ab587-5612-41ad-b232-28a2f9663031 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7915a1bc-614d-4ed8-a26c-40984ebc4c15 req-330ab587-5612-41ad-b232-28a2f9663031 service nova] Acquiring lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7915a1bc-614d-4ed8-a26c-40984ebc4c15 req-330ab587-5612-41ad-b232-28a2f9663031 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7915a1bc-614d-4ed8-a26c-40984ebc4c15 req-330ab587-5612-41ad-b232-28a2f9663031 service nova] Lock "f9b55b06-8a65-4202-b494-f4261c872f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:20 user nova-compute[72803]: DEBUG nova.compute.manager [req-7915a1bc-614d-4ed8-a26c-40984ebc4c15 req-330ab587-5612-41ad-b232-28a2f9663031 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] No waiting events found dispatching network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:20 user nova-compute[72803]: WARNING nova.compute.manager [req-7915a1bc-614d-4ed8-a26c-40984ebc4c15 req-330ab587-5612-41ad-b232-28a2f9663031 service nova] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Received unexpected event network-vif-plugged-f2cc6417-2234-4954-b1a8-d51f14da390f for instance with vm_state deleted and task_state None.
Aug 15 07:23:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "db10606a-343a-48c3-a298-fd31fcb2f8b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:23:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:23:21 user nova-compute[72803]: INFO nova.compute.claims [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Claim successful on node user
Aug 15 07:23:21 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:23:21 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:23:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:23:22 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:23:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:23:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:23:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:23:22 user nova-compute[72803]: INFO nova.virt.block_device [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Booting with volume snapshot 887ea80f-6a2c-4ed3-95d5-b8bc6dc23f1b at /dev/vda
Aug 15 07:23:22 user nova-compute[72803]: DEBUG nova.policy [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '962292c4846b4ceab2cb00867135e136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9714fffd91c94d79aaa288d93fdfaffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-b5cca0a2-5a4a-4a76-afaf-78d23c48f994 req-7138abeb-713c-4fe5-bfb6-d33cd777c1e0 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-changed-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG nova.compute.manager [req-b5cca0a2-5a4a-4a76-afaf-78d23c48f994 req-7138abeb-713c-4fe5-bfb6-d33cd777c1e0 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Refreshing instance network info cache due to event network-changed-067aa359-e89d-413f-b75e-54e39ef2d8c0. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b5cca0a2-5a4a-4a76-afaf-78d23c48f994 req-7138abeb-713c-4fe5-bfb6-d33cd777c1e0 service nova] Acquiring lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b5cca0a2-5a4a-4a76-afaf-78d23c48f994 req-7138abeb-713c-4fe5-bfb6-d33cd777c1e0 service nova] Acquired lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-b5cca0a2-5a4a-4a76-afaf-78d23c48f994 req-7138abeb-713c-4fe5-bfb6-d33cd777c1e0 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Refreshing network info cache for port 067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Successfully created port: ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-b5cca0a2-5a4a-4a76-afaf-78d23c48f994 req-7138abeb-713c-4fe5-bfb6-d33cd777c1e0 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updated VIF entry in instance network info cache for port 067aa359-e89d-413f-b75e-54e39ef2d8c0. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG nova.network.neutron [req-b5cca0a2-5a4a-4a76-afaf-78d23c48f994 req-7138abeb-713c-4fe5-bfb6-d33cd777c1e0 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b5cca0a2-5a4a-4a76-afaf-78d23c48f994 req-7138abeb-713c-4fe5-bfb6-d33cd777c1e0 service nova] Releasing lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:23:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Successfully updated port: ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquired lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG nova.objects.instance [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'flavor' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG nova.network.neutron [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Updating instance_info_cache with network_info: [{"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Releasing lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Instance network_info: |[{"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:24 user nova-compute[72803]: INFO nova.compute.manager [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Attaching volume 1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 to /dev/vdb
Aug 15 07:23:24 user nova-compute[72803]: DEBUG os_brick.utils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b2a00-addd-4907-a339-54ceab2cb77c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f43a8f3-b53b-47e3-b7c3-94ede828666c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a8cabe-5c6a-4bdf-812a-b04f68d1b4e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[330b2a60-b83e-45a2-ac4b-4cf944ae9f10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:23:24 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:23:24 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8033d75d-f15a-4b05-8b20-ecbe82e9dcd1]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG os_brick.utils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating existing volume attachment record: a649cbb5-4dba-4ff8-80e8-31fad6e1cecb {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:23:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-c0fbb225-9186-4c2d-b015-ea19dd072171 req-b835bcc4-e83b-4452-9eac-a3939792541a service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received event network-changed-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG nova.compute.manager [req-c0fbb225-9186-4c2d-b015-ea19dd072171 req-b835bcc4-e83b-4452-9eac-a3939792541a service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Refreshing instance network info cache due to event network-changed-ba087ea7-f859-40e8-9fc4-34d236188c87. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c0fbb225-9186-4c2d-b015-ea19dd072171 req-b835bcc4-e83b-4452-9eac-a3939792541a service nova] Acquiring lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c0fbb225-9186-4c2d-b015-ea19dd072171 req-b835bcc4-e83b-4452-9eac-a3939792541a service nova] Acquired lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG nova.network.neutron [req-c0fbb225-9186-4c2d-b015-ea19dd072171 req-b835bcc4-e83b-4452-9eac-a3939792541a service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Refreshing network info cache for port ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG nova.network.neutron [req-c0fbb225-9186-4c2d-b015-ea19dd072171 req-b835bcc4-e83b-4452-9eac-a3939792541a service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Updated VIF entry in instance network info cache for port ba087ea7-f859-40e8-9fc4-34d236188c87. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG nova.network.neutron [req-c0fbb225-9186-4c2d-b015-ea19dd072171 req-b835bcc4-e83b-4452-9eac-a3939792541a service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Updating instance_info_cache with network_info: [{"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c0fbb225-9186-4c2d-b015-ea19dd072171 req-b835bcc4-e83b-4452-9eac-a3939792541a service nova] Releasing lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:25 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:23:25 user nova-compute[72803]: INFO nova.compute.claims [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Claim successful on node user
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:23:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.policy [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76bdfb1f24e5432fbb1946ad1875a8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35db591e3ed243128111721ee0e6c276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:23:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Creating image(s)
Aug 15 07:23:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "/opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "/opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "/opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "f09012df04ebecdce684b91104887f7c0b9318be" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "f09012df04ebecdce684b91104887f7c0b9318be" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be.part --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be.part --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG nova.virt.images [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] 43013a29-3a4f-4101-b423-fdfb2a1b0f2a was qcow2, converting to raw {{(pid=72803) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG nova.privsep.utils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72803) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be.part /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be.converted {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Successfully created port: 6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be.part /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be.converted" returned: 0 in 0.480s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be.converted --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG os_brick.utils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b318bc-7c53-4599-bf6a-680fccc6db87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "f09012df04ebecdce684b91104887f7c0b9318be" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.402s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[160fbbe6-6c5a-444f-ab3b-ca322e1baa9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[520d2408-fc0c-4822-8f8d-854d649d5987]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bef128-549f-478f-8d18-612a8d5c880d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:23:28 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e332bb-c48b-4f5b-849e-312a7aa5d5b3]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG os_brick.utils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Updating existing volume attachment record: 23a51a65-fe81-486e-b2ae-5c75063d5a4d {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "f09012df04ebecdce684b91104887f7c0b9318be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "f09012df04ebecdce684b91104887f7c0b9318be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Successfully updated port: 6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be --force-share --output=json" returned: 0 in 0.289s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be,backing_fmt=raw /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquired lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be,backing_fmt=raw /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk 1073741824" returned: 0 in 0.060s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "f09012df04ebecdce684b91104887f7c0b9318be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-7448c834-1379-4b2f-a47d-dc963823da8b req-ee01807d-c80d-4300-ba4b-1943ce463eb2 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-7448c834-1379-4b2f-a47d-dc963823da8b req-ee01807d-c80d-4300-ba4b-1943ce463eb2 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing instance network info cache due to event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7448c834-1379-4b2f-a47d-dc963823da8b req-ee01807d-c80d-4300-ba4b-1943ce463eb2 service nova] Acquiring lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Cannot resize image /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'migration_context' on Instance uuid 2856a984-0b77-4f9a-9967-d91248c46148 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Ensure instance console log exists: /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Releasing lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Instance network_info: |[{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7448c834-1379-4b2f-a47d-dc963823da8b req-ee01807d-c80d-4300-ba4b-1943ce463eb2 service nova] Acquired lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.neutron [req-7448c834-1379-4b2f-a47d-dc963823da8b req-ee01807d-c80d-4300-ba4b-1943ce463eb2 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Start _get_guest_xml network_info=[{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T07:23:23Z,direct_url=<?>,disk_format='qcow2',id=43013a29-3a4f-4101-b423-fdfb2a1b0f2a,min_disk=0,min_ram=0,name='tempest-scenario-img--1898916964',owner='35db591e3ed243128111721ee0e6c276',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T07:23:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '43013a29-3a4f-4101-b423-fdfb2a1b0f2a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:23:28 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:23:28 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T07:23:23Z,direct_url=<?>,disk_format='qcow2',id=43013a29-3a4f-4101-b423-fdfb2a1b0f2a,min_disk=0,min_ram=0,name='tempest-scenario-img--1898916964',owner='35db591e3ed243128111721ee0e6c276',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T07:23:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696340707',display_name='tempest-TestMinimumBasicScenario-server-1696340707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696340707',id=46,image_ref='43013a29-3a4f-4101-b423-fdfb2a1b0f2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARCz8c0HXJ9KQOFxrgzmjWdRwj2m4bQ8xfFzcY5VE6hNBnCiQ635zRpQw1GcSmyCZAi44XtZoxZFJJKb02Dbu120KcC3JpTXED0AYLrP5GnaLhK93La/jrLm6IFlEeQQQ==',key_name='tempest-TestMinimumBasicScenario-1922874179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-f04azbwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43013a29-3a4f-4101-b423-fdfb2a1b0f2a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:23:26Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=2856a984-0b77-4f9a-9967-d91248c46148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=6717565a-7ce8-40d6-a04b-bd43f2375ed8,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6717565a-7c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.objects.instance [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'pci_devices' on Instance uuid 2856a984-0b77-4f9a-9967-d91248c46148 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:23:28 user nova-compute[72803]:   <uuid>2856a984-0b77-4f9a-9967-d91248c46148</uuid>
Aug 15 07:23:28 user nova-compute[72803]:   <name>instance-0000002e</name>
Aug 15 07:23:28 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:23:28 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:23:28 user nova-compute[72803]:   <metadata>
Aug 15 07:23:28 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:23:28 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:23:28 user nova-compute[72803]:       <nova:name>tempest-TestMinimumBasicScenario-server-1696340707</nova:name>
Aug 15 07:23:28 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:23:28</nova:creationTime>
Aug 15 07:23:28 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:23:28 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:23:28 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:23:28 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:23:28 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:23:28 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:23:28 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:23:28 user nova-compute[72803]:       <nova:owner>
Aug 15 07:23:28 user nova-compute[72803]:         <nova:user uuid="76bdfb1f24e5432fbb1946ad1875a8f9">tempest-TestMinimumBasicScenario-1832153355-project-member</nova:user>
Aug 15 07:23:28 user nova-compute[72803]:         <nova:project uuid="35db591e3ed243128111721ee0e6c276">tempest-TestMinimumBasicScenario-1832153355</nova:project>
Aug 15 07:23:28 user nova-compute[72803]:       </nova:owner>
Aug 15 07:23:28 user nova-compute[72803]:       <nova:root type="image" uuid="43013a29-3a4f-4101-b423-fdfb2a1b0f2a"/>
Aug 15 07:23:28 user nova-compute[72803]:       <nova:ports>
Aug 15 07:23:28 user nova-compute[72803]:         <nova:port uuid="6717565a-7ce8-40d6-a04b-bd43f2375ed8">
Aug 15 07:23:28 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 07:23:28 user nova-compute[72803]:         </nova:port>
Aug 15 07:23:28 user nova-compute[72803]:       </nova:ports>
Aug 15 07:23:28 user nova-compute[72803]:     </nova:instance>
Aug 15 07:23:28 user nova-compute[72803]:   </metadata>
Aug 15 07:23:28 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:23:28 user nova-compute[72803]:     <system>
Aug 15 07:23:28 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:23:28 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:23:28 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:23:28 user nova-compute[72803]:       <entry name="serial">2856a984-0b77-4f9a-9967-d91248c46148</entry>
Aug 15 07:23:28 user nova-compute[72803]:       <entry name="uuid">2856a984-0b77-4f9a-9967-d91248c46148</entry>
Aug 15 07:23:28 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:23:28 user nova-compute[72803]:     </system>
Aug 15 07:23:28 user nova-compute[72803]:   </sysinfo>
Aug 15 07:23:28 user nova-compute[72803]:   <os>
Aug 15 07:23:28 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:23:28 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:23:28 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:23:28 user nova-compute[72803]:   </os>
Aug 15 07:23:28 user nova-compute[72803]:   <features>
Aug 15 07:23:28 user nova-compute[72803]:     <acpi/>
Aug 15 07:23:28 user nova-compute[72803]:     <apic/>
Aug 15 07:23:28 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:23:28 user nova-compute[72803]:   </features>
Aug 15 07:23:28 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:23:28 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:23:28 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:23:28 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:23:28 user nova-compute[72803]:   </clock>
Aug 15 07:23:28 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:23:28 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:23:28 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:23:28 user nova-compute[72803]:   </cpu>
Aug 15 07:23:28 user nova-compute[72803]:   <devices>
Aug 15 07:23:28 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:23:28 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:23:28 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk"/>
Aug 15 07:23:28 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:23:28 user nova-compute[72803]:     </disk>
Aug 15 07:23:28 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:23:28 user nova-compute[72803]:       <mac address="fa:16:3e:79:6d:19"/>
Aug 15 07:23:28 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:23:28 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:23:28 user nova-compute[72803]:       <target dev="tap6717565a-7c"/>
Aug 15 07:23:28 user nova-compute[72803]:     </interface>
Aug 15 07:23:28 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:23:28 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/console.log" append="off"/>
Aug 15 07:23:28 user nova-compute[72803]:     </serial>
Aug 15 07:23:28 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:23:28 user nova-compute[72803]:     <video>
Aug 15 07:23:28 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:23:28 user nova-compute[72803]:     </video>
Aug 15 07:23:28 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:23:28 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:23:28 user nova-compute[72803]:     </rng>
Aug 15 07:23:28 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:23:28 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:23:28 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:23:28 user nova-compute[72803]:     </memballoon>
Aug 15 07:23:28 user nova-compute[72803]:   </devices>
Aug 15 07:23:28 user nova-compute[72803]: </domain>
Aug 15 07:23:28 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696340707',display_name='tempest-TestMinimumBasicScenario-server-1696340707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696340707',id=46,image_ref='43013a29-3a4f-4101-b423-fdfb2a1b0f2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARCz8c0HXJ9KQOFxrgzmjWdRwj2m4bQ8xfFzcY5VE6hNBnCiQ635zRpQw1GcSmyCZAi44XtZoxZFJJKb02Dbu120KcC3JpTXED0AYLrP5GnaLhK93La/jrLm6IFlEeQQQ==',key_name='tempest-TestMinimumBasicScenario-1922874179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-f04azbwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43013a29-3a4f-4101-b423-fdfb2a1b0f2a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:23:26Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=2856a984-0b77-4f9a-9967-d91248c46148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=6717565a-7ce8-40d6-a04b-bd43f2375ed8,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6717565a-7c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG os_vif [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=6717565a-7ce8-40d6-a04b-bd43f2375ed8,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6717565a-7c') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6717565a-7c, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6717565a-7c, col_values=(('external_ids', {'iface-id': '6717565a-7ce8-40d6-a04b-bd43f2375ed8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:6d:19', 'vm-uuid': '2856a984-0b77-4f9a-9967-d91248c46148'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:23:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:28 user nova-compute[72803]: INFO os_vif [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=6717565a-7ce8-40d6-a04b-bd43f2375ed8,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6717565a-7c')
Aug 15 07:23:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:23:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No VIF found with MAC fa:16:3e:79:6d:19, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:23:29 user nova-compute[72803]: DEBUG nova.network.neutron [req-7448c834-1379-4b2f-a47d-dc963823da8b req-ee01807d-c80d-4300-ba4b-1943ce463eb2 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updated VIF entry in instance network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:23:29 user nova-compute[72803]: DEBUG nova.network.neutron [req-7448c834-1379-4b2f-a47d-dc963823da8b req-ee01807d-c80d-4300-ba4b-1943ce463eb2 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-7448c834-1379-4b2f-a47d-dc963823da8b req-ee01807d-c80d-4300-ba4b-1943ce463eb2 service nova] Releasing lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:23:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-687ec4d0-d179-4b74-84c2-f396692cee9b req-35030330-03bb-4554-a4f7-6ec2ec6b8a67 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-687ec4d0-d179-4b74-84c2-f396692cee9b req-35030330-03bb-4554-a4f7-6ec2ec6b8a67 service nova] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-687ec4d0-d179-4b74-84c2-f396692cee9b req-35030330-03bb-4554-a4f7-6ec2ec6b8a67 service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-687ec4d0-d179-4b74-84c2-f396692cee9b req-35030330-03bb-4554-a4f7-6ec2ec6b8a67 service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG nova.compute.manager [req-687ec4d0-d179-4b74-84c2-f396692cee9b req-35030330-03bb-4554-a4f7-6ec2ec6b8a67 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] No waiting events found dispatching network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:30 user nova-compute[72803]: WARNING nova.compute.manager [req-687ec4d0-d179-4b74-84c2-f396692cee9b req-35030330-03bb-4554-a4f7-6ec2ec6b8a67 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received unexpected event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 for instance with vm_state building and task_state spawning.
Aug 15 07:23:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084212.5184367, 2856a984-0b77-4f9a-9967-d91248c46148 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:23:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] VM Resumed (Lifecycle Event)
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:23:32 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Instance spawned successfully.
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:23:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084212.5210383, 2856a984-0b77-4f9a-9967-d91248c46148 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:23:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] VM Started (Lifecycle Event)
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-449e7b70-cbe5-4634-9db4-ff95aed38434 req-6e25b3e9-8099-49a1-b4a7-37f7667a60dd service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-449e7b70-cbe5-4634-9db4-ff95aed38434 req-6e25b3e9-8099-49a1-b4a7-37f7667a60dd service nova] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-449e7b70-cbe5-4634-9db4-ff95aed38434 req-6e25b3e9-8099-49a1-b4a7-37f7667a60dd service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-449e7b70-cbe5-4634-9db4-ff95aed38434 req-6e25b3e9-8099-49a1-b4a7-37f7667a60dd service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.compute.manager [req-449e7b70-cbe5-4634-9db4-ff95aed38434 req-6e25b3e9-8099-49a1-b4a7-37f7667a60dd service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] No waiting events found dispatching network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:32 user nova-compute[72803]: WARNING nova.compute.manager [req-449e7b70-cbe5-4634-9db4-ff95aed38434 req-6e25b3e9-8099-49a1-b4a7-37f7667a60dd service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received unexpected event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 for instance with vm_state building and task_state spawning.
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:23:32 user nova-compute[72803]: INFO nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 15 07:23:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:23:32 user nova-compute[72803]: INFO nova.compute.manager [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Took 6.86 seconds to build instance.
Aug 15 07:23:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-b5f9d478-fae7-4bc9-a69c-f90cd4f5f57f tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.955s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnGTpvSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:23:33 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:23:33 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:23:33 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[566cd313-54e2-4357-9359-def41b94114b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:23:33 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bee941-ecf6-40f3-a18d-a71785cd79ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8] added
Aug 15 07:23:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084198.8442228, f9b55b06-8a65-4202-b494-f4261c872f62 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:23:33 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] VM Stopped (Lifecycle Event)
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a4b010-5523-4b34-88b6-471631854405]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG nova.compute.manager [None req-fe8fc494-43ba-4924-982c-52c66c94f8f5 None None] [instance: f9b55b06-8a65-4202-b494-f4261c872f62] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aa11a0-ec79-4e5a-b79a-392ed12f447d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnGTpvSs {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnGTpvSs" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a8c0e4-6119-49f9-b7fd-0f6722ea2869]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OnGTpvSs'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e07a559-f74a-4175-9c0e-6233ed1236d6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[db91fa93-8cc7-469a-a53d-7a3c65089907]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:23:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:23:33 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fde28cd-4462-4f6c-ab47-713551473aed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8, portal: 172.16.0.220,3260]
Aug 15 07:23:34 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8, portal: 172.16.0.220,3260] successful.
Aug 15 07:23:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d38141-5fcc-4a13-80b7-e4b347727513]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cdf97c-e57c-480e-a487-ab2315fbf7eb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:23:34 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:23:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:23:34 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:23:34 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65564663-0ef8-4b51-ba47-77ae40708ef9]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnGTpvSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:23:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23261323031326239', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261323031326239', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG nova.objects.instance [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'flavor' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:23:35 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:23:35 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:23:35 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:23:35 user nova-compute[72803]:   <serial>1f9ee06a-61e9-4a60-9dae-7b248d2bcce8</serial>
Aug 15 07:23:35 user nova-compute[72803]: </disk>
Aug 15 07:23:35 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No VIF found with MAC fa:16:3e:af:99:3e, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:23:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-da6a9371-d74f-41a8-83e1-39c9fec9e31b tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.039s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:37 user nova-compute[72803]: INFO nova.compute.manager [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Rescuing
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquired lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:23:37 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Creating image(s)
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Ensure instance console log exists: /opt/stack/data/nova/instances/db10606a-343a-48c3-a298-fd31fcb2f8b4/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Start _get_guest_xml network_info=[{"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T07:23:12Z,direct_url=<?>,disk_format='qcow2',id=511b55df-54e0-435f-b0e0-e47d3e2cb1d9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1468279048',owner='9714fffd91c94d79aaa288d93fdfaffa',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T07:23:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '23a51a65-fe81-486e-b2ae-5c75063d5a4d', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFEBSfCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db10606a-343a-48c3-a298-fd31fcb2f8b4', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9', 'serial': 'ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9'}, 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:23:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:23:37 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T07:23:12Z,direct_url=<?>,disk_format='qcow2',id=511b55df-54e0-435f-b0e0-e47d3e2cb1d9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1468279048',owner='9714fffd91c94d79aaa288d93fdfaffa',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T07:23:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFEBSfCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:23:37 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:23:37 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:23:37 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[324613dc-3f80-43f4-89bc-de4916f11b85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:23:37 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafab9db-21f4-41f4-a94d-9a05730220ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9] added
Aug 15 07:23:37 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[41be2b8c-3c15-4ea7-aded-1f6771ce2f2c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[63660e7c-bc82-4a42-8636-cd861a1fd1de]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jFEBSfCa {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jFEBSfCa" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72e9a1b-b867-4ba9-82bc-efb198795c8f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jFEBSfCa'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc1919-7505-428d-9b7b-9bdd84cc9d2c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b8a95a-84fe-4d1c-ae59-deb325ba8c4c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:23:37 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:23:37 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:23:37 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:23:37 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd5096-13eb-4f53-8d13-daa1c6c0cf4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9, portal: 172.16.0.220,3260]
Aug 15 07:23:37 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9, portal: 172.16.0.220,3260] successful.
Aug 15 07:23:37 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff941b4-888a-4087-81ba-bcae884bf601]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Releasing lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b26e10-663b-4433-a702-1afae09541ce]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:23:37 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:23:37 user nova-compute[72803]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 (non-flash)
Aug 15 07:23:37 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:23:37 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:23:37 user nova-compute[72803]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 (non-flash)
Aug 15 07:23:37 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e5d619-19c9-46da-9eff-19f1e1607e35]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-811345db-ad8c-4c36-9ad3-9da846115502 req-74f7982c-cc95-4e20-8afd-6732a6d71ee2 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-811345db-ad8c-4c36-9ad3-9da846115502 req-74f7982c-cc95-4e20-8afd-6732a6d71ee2 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-811345db-ad8c-4c36-9ad3-9da846115502 req-74f7982c-cc95-4e20-8afd-6732a6d71ee2 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-811345db-ad8c-4c36-9ad3-9da846115502 req-74f7982c-cc95-4e20-8afd-6732a6d71ee2 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-811345db-ad8c-4c36-9ad3-9da846115502 req-74f7982c-cc95-4e20-8afd-6732a6d71ee2 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:37 user nova-compute[72803]: WARNING nova.compute.manager [req-811345db-ad8c-4c36-9ad3-9da846115502 req-74f7982c-cc95-4e20-8afd-6732a6d71ee2 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state rescuing.
Aug 15 07:23:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance destroyed successfully.
Aug 15 07:23:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Attempting rescue
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72803) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance directory exists: not creating {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 07:23:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Creating image(s)
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFEBSfCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26133633138666465', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133633138666465', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-168998022',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-168998022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-168998022',id=45,image_ref='511b55df-54e0-435f-b0e0-e47d3e2cb1d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5VtAxOOwiL5KFscOQAYTC9PNXPvT5cpuLB9jl9h6peDlDNvgj5rsxl+c78ydsuqOtESVDAfnSoxftaxiV8Nn04gNQs6nUInQQCUsoOGuNvvdmmzPlWYmqVm58vlY5IdA==',key_name='tempest-keypair-1078189391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-lg1mz17x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-940544162',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='962292c4846b4ceab2cb00867135e136',uuid=db10606a-343a-48c3-a298-fd31fcb2f8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:de:8e,bridge_name='br-int',has_traffic_filtering=True,id=ba087ea7-f859-40e8-9fc4-34d236188c87,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba087ea7-f8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'pci_devices' on Instance uuid db10606a-343a-48c3-a298-fd31fcb2f8b4 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue" returned: 0 in 0.059s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'migration_context' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:23:38 user nova-compute[72803]:   <uuid>db10606a-343a-48c3-a298-fd31fcb2f8b4</uuid>
Aug 15 07:23:38 user nova-compute[72803]:   <name>instance-0000002d</name>
Aug 15 07:23:38 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:23:38 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:23:38 user nova-compute[72803]:   <metadata>
Aug 15 07:23:38 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:23:38 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-168998022</nova:name>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:23:37</nova:creationTime>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:23:38 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:23:38 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:owner>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:user uuid="962292c4846b4ceab2cb00867135e136">tempest-TestVolumeBootPattern-940544162-project-member</nova:user>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:project uuid="9714fffd91c94d79aaa288d93fdfaffa">tempest-TestVolumeBootPattern-940544162</nova:project>
Aug 15 07:23:38 user nova-compute[72803]:       </nova:owner>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:root type="image" uuid="511b55df-54e0-435f-b0e0-e47d3e2cb1d9"/>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:ports>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:port uuid="ba087ea7-f859-40e8-9fc4-34d236188c87">
Aug 15 07:23:38 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 07:23:38 user nova-compute[72803]:         </nova:port>
Aug 15 07:23:38 user nova-compute[72803]:       </nova:ports>
Aug 15 07:23:38 user nova-compute[72803]:     </nova:instance>
Aug 15 07:23:38 user nova-compute[72803]:   </metadata>
Aug 15 07:23:38 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:23:38 user nova-compute[72803]:     <system>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="serial">db10606a-343a-48c3-a298-fd31fcb2f8b4</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="uuid">db10606a-343a-48c3-a298-fd31fcb2f8b4</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:23:38 user nova-compute[72803]:     </system>
Aug 15 07:23:38 user nova-compute[72803]:   </sysinfo>
Aug 15 07:23:38 user nova-compute[72803]:   <os>
Aug 15 07:23:38 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:23:38 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:23:38 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:23:38 user nova-compute[72803]:   </os>
Aug 15 07:23:38 user nova-compute[72803]:   <features>
Aug 15 07:23:38 user nova-compute[72803]:     <acpi/>
Aug 15 07:23:38 user nova-compute[72803]:     <apic/>
Aug 15 07:23:38 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:23:38 user nova-compute[72803]:   </features>
Aug 15 07:23:38 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:23:38 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:23:38 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:23:38 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:23:38 user nova-compute[72803]:   </clock>
Aug 15 07:23:38 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:23:38 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:23:38 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:23:38 user nova-compute[72803]:   </cpu>
Aug 15 07:23:38 user nova-compute[72803]:   <devices>
Aug 15 07:23:38 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:23:38 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:23:38 user nova-compute[72803]:       <source dev="/dev/sdd"/>
Aug 15 07:23:38 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:23:38 user nova-compute[72803]:       <serial>ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9</serial>
Aug 15 07:23:38 user nova-compute[72803]:     </disk>
Aug 15 07:23:38 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:23:38 user nova-compute[72803]:       <mac address="fa:16:3e:5a:de:8e"/>
Aug 15 07:23:38 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:23:38 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:23:38 user nova-compute[72803]:       <target dev="tapba087ea7-f8"/>
Aug 15 07:23:38 user nova-compute[72803]:     </interface>
Aug 15 07:23:38 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:23:38 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/db10606a-343a-48c3-a298-fd31fcb2f8b4/console.log" append="off"/>
Aug 15 07:23:38 user nova-compute[72803]:     </serial>
Aug 15 07:23:38 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:23:38 user nova-compute[72803]:     <video>
Aug 15 07:23:38 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:23:38 user nova-compute[72803]:     </video>
Aug 15 07:23:38 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:23:38 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:23:38 user nova-compute[72803]:     </rng>
Aug 15 07:23:38 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:23:38 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:23:38 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:23:38 user nova-compute[72803]:     </memballoon>
Aug 15 07:23:38 user nova-compute[72803]:   </devices>
Aug 15 07:23:38 user nova-compute[72803]: </domain>
Aug 15 07:23:38 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-168998022',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-168998022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-168998022',id=45,image_ref='511b55df-54e0-435f-b0e0-e47d3e2cb1d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5VtAxOOwiL5KFscOQAYTC9PNXPvT5cpuLB9jl9h6peDlDNvgj5rsxl+c78ydsuqOtESVDAfnSoxftaxiV8Nn04gNQs6nUInQQCUsoOGuNvvdmmzPlWYmqVm58vlY5IdA==',key_name='tempest-keypair-1078189391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-lg1mz17x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-940544162',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='962292c4846b4ceab2cb00867135e136',uuid=db10606a-343a-48c3-a298-fd31fcb2f8b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:de:8e,bridge_name='br-int',has_traffic_filtering=True,id=ba087ea7-f859-40e8-9fc4-34d236188c87,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba087ea7-f8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG os_vif [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:de:8e,bridge_name='br-int',has_traffic_filtering=True,id=ba087ea7-f859-40e8-9fc4-34d236188c87,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba087ea7-f8') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Start _get_guest_xml network_info=[{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:af:99:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'resources' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba087ea7-f8, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba087ea7-f8, col_values=(('external_ids', {'iface-id': 'ba087ea7-f859-40e8-9fc4-34d236188c87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:de:8e', 'vm-uuid': 'db10606a-343a-48c3-a298-fd31fcb2f8b4'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'numa_topology' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: INFO os_vif [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:de:8e,bridge_name='br-int',has_traffic_filtering=True,id=ba087ea7-f859-40e8-9fc4-34d236188c87,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba087ea7-f8')
Aug 15 07:23:38 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:23:38 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-218054654',display_name='tempest-ServerRescueNegativeTestJSON-server-218054654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-218054654',id=44,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQoL7M/7lnh5ItsBC6ALybOX/qAelb5zwvWOrtJfhGWPzbxUVb8Z044Dfm1/KTq1HuH+P/Zt8jQNokZ+L/cPHpZ+AR8Swrzeg15f6ft03NqW1hZRn+lz8vFgJfj10yUzg==',key_name='tempest-keypair-775720222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:21:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-vjnaaghm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cf4a499a9d54262bd8959b87918717c',uuid=4689e7e1-47e5-435f-b0f2-32327f955285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:af:99:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "vif_mac": "fa:16:3e:af:99:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:99:3e,bridge_name='br-int',has_traffic_filtering=True,id=067aa359-e89d-413f-b75e-54e39ef2d8c0,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067aa359-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.objects.instance [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'pci_devices' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:23:38 user nova-compute[72803]:   <uuid>4689e7e1-47e5-435f-b0f2-32327f955285</uuid>
Aug 15 07:23:38 user nova-compute[72803]:   <name>instance-0000002c</name>
Aug 15 07:23:38 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:23:38 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:23:38 user nova-compute[72803]:   <metadata>
Aug 15 07:23:38 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:23:38 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-218054654</nova:name>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:23:38</nova:creationTime>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:23:38 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:23:38 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:owner>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:user uuid="0cf4a499a9d54262bd8959b87918717c">tempest-ServerRescueNegativeTestJSON-1974019782-project-member</nova:user>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:project uuid="eaa8ac0862d14e7792d6c03f46c170ba">tempest-ServerRescueNegativeTestJSON-1974019782</nova:project>
Aug 15 07:23:38 user nova-compute[72803]:       </nova:owner>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:23:38 user nova-compute[72803]:       <nova:ports>
Aug 15 07:23:38 user nova-compute[72803]:         <nova:port uuid="067aa359-e89d-413f-b75e-54e39ef2d8c0">
Aug 15 07:23:38 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 07:23:38 user nova-compute[72803]:         </nova:port>
Aug 15 07:23:38 user nova-compute[72803]:       </nova:ports>
Aug 15 07:23:38 user nova-compute[72803]:     </nova:instance>
Aug 15 07:23:38 user nova-compute[72803]:   </metadata>
Aug 15 07:23:38 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:23:38 user nova-compute[72803]:     <system>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="serial">4689e7e1-47e5-435f-b0f2-32327f955285</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="uuid">4689e7e1-47e5-435f-b0f2-32327f955285</entry>
Aug 15 07:23:38 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:23:38 user nova-compute[72803]:     </system>
Aug 15 07:23:38 user nova-compute[72803]:   </sysinfo>
Aug 15 07:23:38 user nova-compute[72803]:   <os>
Aug 15 07:23:38 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:23:38 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:23:38 user nova-compute[72803]:   </os>
Aug 15 07:23:38 user nova-compute[72803]:   <features>
Aug 15 07:23:38 user nova-compute[72803]:     <acpi/>
Aug 15 07:23:38 user nova-compute[72803]:     <apic/>
Aug 15 07:23:38 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:23:38 user nova-compute[72803]:   </features>
Aug 15 07:23:38 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:23:38 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:23:38 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:23:38 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:23:38 user nova-compute[72803]:   </clock>
Aug 15 07:23:38 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:23:38 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:23:38 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:23:38 user nova-compute[72803]:   </cpu>
Aug 15 07:23:38 user nova-compute[72803]:   <devices>
Aug 15 07:23:38 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:23:38 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:23:38 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue"/>
Aug 15 07:23:38 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:23:38 user nova-compute[72803]:     </disk>
Aug 15 07:23:38 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:23:38 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:23:38 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk"/>
Aug 15 07:23:38 user nova-compute[72803]:       <target dev="vdb" bus="virtio"/>
Aug 15 07:23:38 user nova-compute[72803]:     </disk>
Aug 15 07:23:38 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:23:38 user nova-compute[72803]:       <mac address="fa:16:3e:af:99:3e"/>
Aug 15 07:23:38 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:23:38 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:23:38 user nova-compute[72803]:       <target dev="tap067aa359-e8"/>
Aug 15 07:23:38 user nova-compute[72803]:     </interface>
Aug 15 07:23:38 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:23:38 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/console.log" append="off"/>
Aug 15 07:23:38 user nova-compute[72803]:     </serial>
Aug 15 07:23:38 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:23:38 user nova-compute[72803]:     <video>
Aug 15 07:23:38 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:23:38 user nova-compute[72803]:     </video>
Aug 15 07:23:38 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:23:38 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:23:38 user nova-compute[72803]:     </rng>
Aug 15 07:23:38 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:23:38 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:23:38 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:23:38 user nova-compute[72803]:     </memballoon>
Aug 15 07:23:38 user nova-compute[72803]:   </devices>
Aug 15 07:23:38 user nova-compute[72803]: </domain>
Aug 15 07:23:38 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No VIF found with MAC fa:16:3e:5a:de:8e, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:23:38 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance destroyed successfully.
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:23:38 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] No VIF found with MAC fa:16:3e:af:99:3e, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:39 user nova-compute[72803]: WARNING nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state rescuing.
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:39 user nova-compute[72803]: WARNING nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state rescuing.
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:39 user nova-compute[72803]: WARNING nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state rescuing.
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:39 user nova-compute[72803]: WARNING nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state rescuing.
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:39 user nova-compute[72803]: DEBUG nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:39 user nova-compute[72803]: WARNING nova.compute.manager [req-6a14a33d-98bd-4644-8d40-c90c86b76f5c req-311b3d95-df4a-4005-8245-e62b2124b141 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state rescuing.
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG nova.compute.manager [req-9a0a6df4-1ee5-400d-a2fd-20b046886ff0 req-434af70a-c85d-4b71-b9c6-23d199eb15bc service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received event network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9a0a6df4-1ee5-400d-a2fd-20b046886ff0 req-434af70a-c85d-4b71-b9c6-23d199eb15bc service nova] Acquiring lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9a0a6df4-1ee5-400d-a2fd-20b046886ff0 req-434af70a-c85d-4b71-b9c6-23d199eb15bc service nova] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9a0a6df4-1ee5-400d-a2fd-20b046886ff0 req-434af70a-c85d-4b71-b9c6-23d199eb15bc service nova] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG nova.compute.manager [req-9a0a6df4-1ee5-400d-a2fd-20b046886ff0 req-434af70a-c85d-4b71-b9c6-23d199eb15bc service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] No waiting events found dispatching network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:41 user nova-compute[72803]: WARNING nova.compute.manager [req-9a0a6df4-1ee5-400d-a2fd-20b046886ff0 req-434af70a-c85d-4b71-b9c6-23d199eb15bc service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received unexpected event network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 for instance with vm_state building and task_state spawning.
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:41 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:42 user nova-compute[72803]: WARNING nova.compute.manager [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state rescuing.
Aug 15 07:23:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:42 user nova-compute[72803]: WARNING nova.compute.manager [req-33276f60-5c57-4e54-b13e-13f1ea1bdbd1 req-28923387-544d-4959-807c-05a0b68a560e service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state rescuing.
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-8665a3da-1998-4e04-813f-39b5b0d12a00 req-7fcd0cc1-8b9e-4071-b07c-99184d760075 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received event network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8665a3da-1998-4e04-813f-39b5b0d12a00 req-7fcd0cc1-8b9e-4071-b07c-99184d760075 service nova] Acquiring lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8665a3da-1998-4e04-813f-39b5b0d12a00 req-7fcd0cc1-8b9e-4071-b07c-99184d760075 service nova] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8665a3da-1998-4e04-813f-39b5b0d12a00 req-7fcd0cc1-8b9e-4071-b07c-99184d760075 service nova] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [req-8665a3da-1998-4e04-813f-39b5b0d12a00 req-7fcd0cc1-8b9e-4071-b07c-99184d760075 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] No waiting events found dispatching network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:23:43 user nova-compute[72803]: WARNING nova.compute.manager [req-8665a3da-1998-4e04-813f-39b5b0d12a00 req-7fcd0cc1-8b9e-4071-b07c-99184d760075 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received unexpected event network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 for instance with vm_state building and task_state spawning.
Aug 15 07:23:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084223.846734, db10606a-343a-48c3-a298-fd31fcb2f8b4 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:23:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] VM Resumed (Lifecycle Event)
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:23:43 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Instance spawned successfully.
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8d50eb71-7e60-43ab-a5d4-1bdebc1a46de tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:23:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084223.8477712, db10606a-343a-48c3-a298-fd31fcb2f8b4 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:23:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] VM Started (Lifecycle Event)
Aug 15 07:23:43 user nova-compute[72803]: INFO nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Took 6.70 seconds to spawn the instance on the hypervisor.
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:23:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 4689e7e1-47e5-435f-b0f2-32327f955285 due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:23:43 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084223.8725007, 4689e7e1-47e5-435f-b0f2-32327f955285 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:23:43 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] VM Resumed (Lifecycle Event)
Aug 15 07:23:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:44 user nova-compute[72803]: INFO nova.compute.manager [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Took 22.31 seconds to build instance.
Aug 15 07:23:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:23:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2f67959a-db02-4d58-a7da-3e275a07c856 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.400s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:44 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084223.8736348, 4689e7e1-47e5-435f-b0f2-32327f955285 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:23:44 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] VM Started (Lifecycle Event)
Aug 15 07:23:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:23:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:23:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:48 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:48 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:50 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:51 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:52 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:23:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:54 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:23:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:24:00 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:24:00 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=7967MB free_disk=25.188007354736328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 26375ab8-3a94-45e6-b847-1d4d707a6450 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4689e7e1-47e5-435f-b0f2-32327f955285 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance db10606a-343a-48c3-a298-fd31fcb2f8b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 2856a984-0b77-4f9a-9967-d91248c46148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:24:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:24:01 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:24:01 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:24:01 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:24:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:24:03 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:24:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:24:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:24:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:24:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:24:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:24:03 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:24:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:24:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:24:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:24:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:24:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:24:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:24:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:24:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:24:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:24:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:24:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:24:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:24:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:24:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:24:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:24:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:24:53 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:24:53 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:24:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:24:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:24:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:24:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:24:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:24:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:24:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:24:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:25:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:25:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:25:02 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8161MB free_disk=25.185771942138672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:25:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 26375ab8-3a94-45e6-b847-1d4d707a6450 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4689e7e1-47e5-435f-b0f2-32327f955285 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance db10606a-343a-48c3-a298-fd31fcb2f8b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 2856a984-0b77-4f9a-9967-d91248c46148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:25:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:25:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:25:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:25:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:25:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updating instance_info_cache with network_info: [{"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:25:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-511e9555-52a0-4f2c-b4ff-0f68ba2c32be" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:25:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:25:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:25:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:25:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:25:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:25:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-9620f2f1-c7c7-415b-ad21-e9a3b395c270 req-33023a06-c0b8-4405-b82e-dd9c6ba880ba service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received event network-changed-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-9620f2f1-c7c7-415b-ad21-e9a3b395c270 req-33023a06-c0b8-4405-b82e-dd9c6ba880ba service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Refreshing instance network info cache due to event network-changed-ba087ea7-f859-40e8-9fc4-34d236188c87. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:25:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9620f2f1-c7c7-415b-ad21-e9a3b395c270 req-33023a06-c0b8-4405-b82e-dd9c6ba880ba service nova] Acquiring lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:25:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9620f2f1-c7c7-415b-ad21-e9a3b395c270 req-33023a06-c0b8-4405-b82e-dd9c6ba880ba service nova] Acquired lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:25:12 user nova-compute[72803]: DEBUG nova.network.neutron [req-9620f2f1-c7c7-415b-ad21-e9a3b395c270 req-33023a06-c0b8-4405-b82e-dd9c6ba880ba service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Refreshing network info cache for port ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG nova.network.neutron [req-9620f2f1-c7c7-415b-ad21-e9a3b395c270 req-33023a06-c0b8-4405-b82e-dd9c6ba880ba service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Updated VIF entry in instance network info cache for port ba087ea7-f859-40e8-9fc4-34d236188c87. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG nova.network.neutron [req-9620f2f1-c7c7-415b-ad21-e9a3b395c270 req-33023a06-c0b8-4405-b82e-dd9c6ba880ba service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Updating instance_info_cache with network_info: [{"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9620f2f1-c7c7-415b-ad21-e9a3b395c270 req-33023a06-c0b8-4405-b82e-dd9c6ba880ba service nova] Releasing lock "refresh_cache-db10606a-343a-48c3-a298-fd31fcb2f8b4" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "db10606a-343a-48c3-a298-fd31fcb2f8b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:13 user nova-compute[72803]: INFO nova.compute.manager [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Terminating instance
Aug 15 07:25:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-eaef0dc4-87e2-4f29-a6a0-9870b74e0685 req-4c08aaa4-fe8f-4a7b-aba7-47ae74faeb64 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received event network-vif-unplugged-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaef0dc4-87e2-4f29-a6a0-9870b74e0685 req-4c08aaa4-fe8f-4a7b-aba7-47ae74faeb64 service nova] Acquiring lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaef0dc4-87e2-4f29-a6a0-9870b74e0685 req-4c08aaa4-fe8f-4a7b-aba7-47ae74faeb64 service nova] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaef0dc4-87e2-4f29-a6a0-9870b74e0685 req-4c08aaa4-fe8f-4a7b-aba7-47ae74faeb64 service nova] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-eaef0dc4-87e2-4f29-a6a0-9870b74e0685 req-4c08aaa4-fe8f-4a7b-aba7-47ae74faeb64 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] No waiting events found dispatching network-vif-unplugged-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-eaef0dc4-87e2-4f29-a6a0-9870b74e0685 req-4c08aaa4-fe8f-4a7b-aba7-47ae74faeb64 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received event network-vif-unplugged-ba087ea7-f859-40e8-9fc4-34d236188c87 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Instance destroyed successfully.
Aug 15 07:25:14 user nova-compute[72803]: DEBUG nova.objects.instance [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'resources' on Instance uuid db10606a-343a-48c3-a298-fd31fcb2f8b4 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-168998022',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-168998022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-168998022',id=45,image_ref='511b55df-54e0-435f-b0e0-e47d3e2cb1d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5VtAxOOwiL5KFscOQAYTC9PNXPvT5cpuLB9jl9h6peDlDNvgj5rsxl+c78ydsuqOtESVDAfnSoxftaxiV8Nn04gNQs6nUInQQCUsoOGuNvvdmmzPlWYmqVm58vlY5IdA==',key_name='tempest-keypair-1078189391',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-lg1mz17x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-940544162',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='962292c4846b4ceab2cb00867135e136',uuid=db10606a-343a-48c3-a298-fd31fcb2f8b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "ba087ea7-f859-40e8-9fc4-34d236188c87", "address": "fa:16:3e:5a:de:8e", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba087ea7-f8", "ovs_interfaceid": "ba087ea7-f859-40e8-9fc4-34d236188c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:de:8e,bridge_name='br-int',has_traffic_filtering=True,id=ba087ea7-f859-40e8-9fc4-34d236188c87,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba087ea7-f8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_vif [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:de:8e,bridge_name='br-int',has_traffic_filtering=True,id=ba087ea7-f859-40e8-9fc4-34d236188c87,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba087ea7-f8') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba087ea7-f8, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:25:14 user nova-compute[72803]: INFO os_vif [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:de:8e,bridge_name='br-int',has_traffic_filtering=True,id=ba087ea7-f859-40e8-9fc4-34d236188c87,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba087ea7-f8')
Aug 15 07:25:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jFEBSfCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:25:14 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8831695-9009-41c9-b3bd-98b545c549bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0476f873-46b1-4a2d-b5b9-76a8ece79e46]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:25:14 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:25:14 user nova-compute[72803]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 (non-flash)
Aug 15 07:25:14 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:25:14 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:25:14 user nova-compute[72803]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 (non-flash)
Aug 15 07:25:14 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e011d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[02baf53b-9834-447a-a071-c18c7991278d]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[740273cc-e5f5-4683-9d6f-8ab8ba9a698c]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[06078ce2-1b15-498c-a520-54effc3ee5c9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58ebcf-41be-48a2-8f9f-b4dee7b68029]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26133633138666465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9fa135b0', '/dev/disk/by-id/scsi-1SCST_BIO9fa135b0-a3c18fdeedaa6d87') {{(pid=84151) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cc978c-d033-420e-9f59-7fc0b12f7e8d]: (4, None) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4532a1fd-08dd-4ab7-b2ea-48ccf42b7a6e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfc9e33-4022-430b-8ca0-03b486163419]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9, portal: 172.16.0.220,3260]
Aug 15 07:25:14 user nova-compute[72803]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9, portal: 172.16.0.220,3260] successful.
Aug 15 07:25:14 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d6365e-5c7a-4556-9ef6-f507e4e33c8f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== disconnect_volume: return (300ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:25:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Deleting instance files /opt/stack/data/nova/instances/db10606a-343a-48c3-a298-fd31fcb2f8b4_del
Aug 15 07:25:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Deletion of /opt/stack/data/nova/instances/db10606a-343a-48c3-a298-fd31fcb2f8b4_del complete
Aug 15 07:25:14 user nova-compute[72803]: INFO nova.compute.manager [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 07:25:14 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:25:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:15 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:25:15 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Took 0.78 seconds to deallocate network for instance.
Aug 15 07:25:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-7711a8c5-afca-46cf-96c5-84e9c88e6af2 req-ed836420-bacc-427f-9047-6459b2a4e690 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received event network-vif-deleted-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:15 user nova-compute[72803]: INFO nova.compute.manager [req-7711a8c5-afca-46cf-96c5-84e9c88e6af2 req-ed836420-bacc-427f-9047-6459b2a4e690 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Neutron deleted interface ba087ea7-f859-40e8-9fc4-34d236188c87; detaching it from the instance and deleting it from the info cache
Aug 15 07:25:15 user nova-compute[72803]: DEBUG nova.network.neutron [req-7711a8c5-afca-46cf-96c5-84e9c88e6af2 req-ed836420-bacc-427f-9047-6459b2a4e690 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:25:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-7711a8c5-afca-46cf-96c5-84e9c88e6af2 req-ed836420-bacc-427f-9047-6459b2a4e690 service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Detach interface failed, port_id=ba087ea7-f859-40e8-9fc4-34d236188c87, reason: Instance db10606a-343a-48c3-a298-fd31fcb2f8b4 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:25:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-49065fc2-f57e-41cd-9d26-1f9d46f20357 req-91bbc448-07df-4039-83b6-01a65ce5a56a service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received event network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-49065fc2-f57e-41cd-9d26-1f9d46f20357 req-91bbc448-07df-4039-83b6-01a65ce5a56a service nova] Acquiring lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-49065fc2-f57e-41cd-9d26-1f9d46f20357 req-91bbc448-07df-4039-83b6-01a65ce5a56a service nova] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-49065fc2-f57e-41cd-9d26-1f9d46f20357 req-91bbc448-07df-4039-83b6-01a65ce5a56a service nova] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:15 user nova-compute[72803]: DEBUG nova.compute.manager [req-49065fc2-f57e-41cd-9d26-1f9d46f20357 req-91bbc448-07df-4039-83b6-01a65ce5a56a service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] No waiting events found dispatching network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:15 user nova-compute[72803]: WARNING nova.compute.manager [req-49065fc2-f57e-41cd-9d26-1f9d46f20357 req-91bbc448-07df-4039-83b6-01a65ce5a56a service nova] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Received unexpected event network-vif-plugged-ba087ea7-f859-40e8-9fc4-34d236188c87 for instance with vm_state active and task_state deleting.
Aug 15 07:25:16 user nova-compute[72803]: INFO nova.compute.manager [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Took 0.79 seconds to detach 1 volumes for instance.
Aug 15 07:25:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Deleting volume: ffcf3e75-0653-449a-8ac4-8e1bbbf26fd9 {{(pid=72803) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 07:25:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:16 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:25:16 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:25:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:16 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Deleted allocations for instance db10606a-343a-48c3-a298-fd31fcb2f8b4
Aug 15 07:25:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-5d495993-f8fb-4678-a687-d7f08d79cc88 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "db10606a-343a-48c3-a298-fd31fcb2f8b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.262s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'flavor' on Instance uuid 2856a984-0b77-4f9a-9967-d91248c46148 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:20 user nova-compute[72803]: INFO nova.compute.manager [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Attaching volume ab4c68d4-e422-4305-b1b9-e68a535a175b to /dev/vdb
Aug 15 07:25:20 user nova-compute[72803]: DEBUG os_brick.utils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb4e103-f95d-487c-bcc6-3a4de7cfa39c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff13cbd-0324-45a0-af18-153890a20390]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad31665b-7c24-41e1-aead-bb626d31f74f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ce5f08-087e-4802-a47b-93e16ca0c4ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:25:20 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:25:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9392e1d8-7680-4b0f-b362-2c5d2117fd6d]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG os_brick.utils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:25:20 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating existing volume attachment record: 88784d09-7e92-45ce-b46a-b8eb07705eae {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:25:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:25:28 user nova-compute[72803]: INFO nova.compute.manager [None req-04b139d2-3142-45bc-82ac-172e9dbe6fc5 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Unrescuing
Aug 15 07:25:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04b139d2-3142-45bc-82ac-172e9dbe6fc5 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04b139d2-3142-45bc-82ac-172e9dbe6fc5 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquired lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-04b139d2-3142-45bc-82ac-172e9dbe6fc5 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG nova.network.neutron [None req-04b139d2-3142-45bc-82ac-172e9dbe6fc5 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-04b139d2-3142-45bc-82ac-172e9dbe6fc5 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Releasing lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG nova.objects.instance [None req-04b139d2-3142-45bc-82ac-172e9dbe6fc5 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'flavor' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f70f584-d8cd-46cd-902f-f14e18cbae57 req-d67f326e-c4d8-4418-8bf4-d8d64b0da804 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f70f584-d8cd-46cd-902f-f14e18cbae57 req-d67f326e-c4d8-4418-8bf4-d8d64b0da804 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f70f584-d8cd-46cd-902f-f14e18cbae57 req-d67f326e-c4d8-4418-8bf4-d8d64b0da804 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f70f584-d8cd-46cd-902f-f14e18cbae57 req-d67f326e-c4d8-4418-8bf4-d8d64b0da804 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f70f584-d8cd-46cd-902f-f14e18cbae57 req-d67f326e-c4d8-4418-8bf4-d8d64b0da804 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:28 user nova-compute[72803]: WARNING nova.compute.manager [req-3f70f584-d8cd-46cd-902f-f14e18cbae57 req-d67f326e-c4d8-4418-8bf4-d8d64b0da804 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:25:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084314.2219594, db10606a-343a-48c3-a298-fd31fcb2f8b4 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:25:29 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] VM Stopped (Lifecycle Event)
Aug 15 07:25:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance destroyed successfully.
Aug 15 07:25:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-8fa51ff6-291c-4aaa-b4a2-215f9f613bee None None] [instance: db10606a-343a-48c3-a298-fd31fcb2f8b4] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVgXjEAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:25:29 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:25:29 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:25:29 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0ff2a1-4bb7-404c-bb01-d66367a5d44f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:25:29 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e760818-6dfb-4037-b9c2-a3ab588cdd4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b] added
Aug 15 07:25:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e22c72-f807-44fe-b00e-51379188e16d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[af017a25-c8a8-40ce-ae3b-048ef977fc9e]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVgXjEAD {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVgXjEAD" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b8775a-bddc-44b1-9dfd-8d3849f54e1b]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YVgXjEAD'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[179d6f9c-96e6-4c00-b1d8-a9510283fc52]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[db332900-ca94-42fd-9bd1-b356700f6386]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:25:29 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:25:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:25:29 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:25:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc3785-e239-4ab7-ab0f-80df6f0135c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b, portal: 172.16.0.220,3260]
Aug 15 07:25:29 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b, portal: 172.16.0.220,3260] successful.
Aug 15 07:25:29 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:29 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1656062a-2a92-4c46-b702-7d1b5d3f371a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a1ed2-3b6e-431c-966e-3be70b247d98]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:25:30 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:25:30 user nova-compute[72803]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:25:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:25:30 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:25:30 user nova-compute[72803]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:25:30 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba8078e-a879-4654-a6bb-7b2da3863f55]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVgXjEAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:31 user nova-compute[72803]: WARNING nova.compute.manager [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:31 user nova-compute[72803]: WARNING nova.compute.manager [req-ed93def0-dfef-494a-bc37-50d881c9a5ec req-601c0584-322b-4927-9866-c1c9febb8e42 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 07:25:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23232363131633432', 'path': '/dev/sdd'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232363131633432', 'path': '/dev/sdd'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'flavor' on Instance uuid 2856a984-0b77-4f9a-9967-d91248c46148 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:25:31 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:25:31 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:25:31 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:25:31 user nova-compute[72803]:   <serial>ab4c68d4-e422-4305-b1b9-e68a535a175b</serial>
Aug 15 07:25:31 user nova-compute[72803]: </disk>
Aug 15 07:25:31 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] No VIF found with MAC fa:16:3e:79:6d:19, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:25:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1af3c29d-01d5-454f-8552-5632e272b929 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.099s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:32 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 4689e7e1-47e5-435f-b0f2-32327f955285 due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:25:32 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084332.6909273, 4689e7e1-47e5-435f-b0f2-32327f955285 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:25:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] VM Resumed (Lifecycle Event)
Aug 15 07:25:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-04b139d2-3142-45bc-82ac-172e9dbe6fc5 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:25:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:25:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:25:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 07:25:32 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084332.692852, 4689e7e1-47e5-435f-b0f2-32327f955285 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:25:32 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] VM Started (Lifecycle Event)
Aug 15 07:25:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:25:32 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:25:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-00c5a99d-06f3-46e7-a5c9-b52e5478c77a req-f1d6a089-7b83-45d0-a0a5-8a68bb2bc08b service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-00c5a99d-06f3-46e7-a5c9-b52e5478c77a req-f1d6a089-7b83-45d0-a0a5-8a68bb2bc08b service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-00c5a99d-06f3-46e7-a5c9-b52e5478c77a req-f1d6a089-7b83-45d0-a0a5-8a68bb2bc08b service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-00c5a99d-06f3-46e7-a5c9-b52e5478c77a req-f1d6a089-7b83-45d0-a0a5-8a68bb2bc08b service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:33 user nova-compute[72803]: DEBUG nova.compute.manager [req-00c5a99d-06f3-46e7-a5c9-b52e5478c77a req-f1d6a089-7b83-45d0-a0a5-8a68bb2bc08b service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:33 user nova-compute[72803]: WARNING nova.compute.manager [req-00c5a99d-06f3-46e7-a5c9-b52e5478c77a req-f1d6a089-7b83-45d0-a0a5-8a68bb2bc08b service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state active and task_state None.
Aug 15 07:25:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-73e93bf4-14ab-4ac6-b022-9f7662d10830 req-c7625024-e4e0-498c-bc2b-2b6ef989a979 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:34 user nova-compute[72803]: DEBUG nova.compute.manager [req-73e93bf4-14ab-4ac6-b022-9f7662d10830 req-c7625024-e4e0-498c-bc2b-2b6ef989a979 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing instance network info cache due to event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:25:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-73e93bf4-14ab-4ac6-b022-9f7662d10830 req-c7625024-e4e0-498c-bc2b-2b6ef989a979 service nova] Acquiring lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:25:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-73e93bf4-14ab-4ac6-b022-9f7662d10830 req-c7625024-e4e0-498c-bc2b-2b6ef989a979 service nova] Acquired lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:25:34 user nova-compute[72803]: DEBUG nova.network.neutron [req-73e93bf4-14ab-4ac6-b022-9f7662d10830 req-c7625024-e4e0-498c-bc2b-2b6ef989a979 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:25:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:35 user nova-compute[72803]: DEBUG nova.network.neutron [req-73e93bf4-14ab-4ac6-b022-9f7662d10830 req-c7625024-e4e0-498c-bc2b-2b6ef989a979 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updated VIF entry in instance network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:25:35 user nova-compute[72803]: DEBUG nova.network.neutron [req-73e93bf4-14ab-4ac6-b022-9f7662d10830 req-c7625024-e4e0-498c-bc2b-2b6ef989a979 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:25:35 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-73e93bf4-14ab-4ac6-b022-9f7662d10830 req-c7625024-e4e0-498c-bc2b-2b6ef989a979 service nova] Releasing lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-97213fc0-94bf-4841-aec4-035d2b3f8481 req-b48febca-dc54-42e7-88af-40546a260774 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG nova.compute.manager [req-97213fc0-94bf-4841-aec4-035d2b3f8481 req-b48febca-dc54-42e7-88af-40546a260774 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing instance network info cache due to event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97213fc0-94bf-4841-aec4-035d2b3f8481 req-b48febca-dc54-42e7-88af-40546a260774 service nova] Acquiring lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97213fc0-94bf-4841-aec4-035d2b3f8481 req-b48febca-dc54-42e7-88af-40546a260774 service nova] Acquired lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG nova.network.neutron [req-97213fc0-94bf-4841-aec4-035d2b3f8481 req-b48febca-dc54-42e7-88af-40546a260774 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG nova.network.neutron [req-97213fc0-94bf-4841-aec4-035d2b3f8481 req-b48febca-dc54-42e7-88af-40546a260774 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updated VIF entry in instance network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG nova.network.neutron [req-97213fc0-94bf-4841-aec4-035d2b3f8481 req-b48febca-dc54-42e7-88af-40546a260774 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-97213fc0-94bf-4841-aec4-035d2b3f8481 req-b48febca-dc54-42e7-88af-40546a260774 service nova] Releasing lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:37 user nova-compute[72803]: INFO nova.compute.manager [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Rebooting instance
Aug 15 07:25:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquired lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:25:37 user nova-compute[72803]: DEBUG nova.network.neutron [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:25:38 user nova-compute[72803]: DEBUG nova.network.neutron [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:25:38 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Releasing lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:25:38 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:25:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-3d3aa8f1-4f7c-4df5-9541-d41f998eafba req-616b2bd3-b7ff-4a89-b3e8-d86c25f3e0fc service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-unplugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3d3aa8f1-4f7c-4df5-9541-d41f998eafba req-616b2bd3-b7ff-4a89-b3e8-d86c25f3e0fc service nova] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3d3aa8f1-4f7c-4df5-9541-d41f998eafba req-616b2bd3-b7ff-4a89-b3e8-d86c25f3e0fc service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3d3aa8f1-4f7c-4df5-9541-d41f998eafba req-616b2bd3-b7ff-4a89-b3e8-d86c25f3e0fc service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:40 user nova-compute[72803]: DEBUG nova.compute.manager [req-3d3aa8f1-4f7c-4df5-9541-d41f998eafba req-616b2bd3-b7ff-4a89-b3e8-d86c25f3e0fc service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] No waiting events found dispatching network-vif-unplugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:40 user nova-compute[72803]: WARNING nova.compute.manager [req-3d3aa8f1-4f7c-4df5-9541-d41f998eafba req-616b2bd3-b7ff-4a89-b3e8-d86c25f3e0fc service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received unexpected event network-vif-unplugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 for instance with vm_state active and task_state reboot_started.
Aug 15 07:25:41 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Instance shutdown successfully.
Aug 15 07:25:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-f3af479b-2058-4134-9b17-6ffbd51298eb req-8f1f4e20-3069-4600-bbe7-c326da1dc6c7 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f3af479b-2058-4134-9b17-6ffbd51298eb req-8f1f4e20-3069-4600-bbe7-c326da1dc6c7 service nova] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f3af479b-2058-4134-9b17-6ffbd51298eb req-8f1f4e20-3069-4600-bbe7-c326da1dc6c7 service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:42 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-f3af479b-2058-4134-9b17-6ffbd51298eb req-8f1f4e20-3069-4600-bbe7-c326da1dc6c7 service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:42 user nova-compute[72803]: DEBUG nova.compute.manager [req-f3af479b-2058-4134-9b17-6ffbd51298eb req-8f1f4e20-3069-4600-bbe7-c326da1dc6c7 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] No waiting events found dispatching network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:42 user nova-compute[72803]: WARNING nova.compute.manager [req-f3af479b-2058-4134-9b17-6ffbd51298eb req-8f1f4e20-3069-4600-bbe7-c326da1dc6c7 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received unexpected event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 for instance with vm_state active and task_state reboot_started.
Aug 15 07:25:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Removed pending event for 2856a984-0b77-4f9a-9967-d91248c46148 due to event {{(pid=72803) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084345.0093434, 2856a984-0b77-4f9a-9967-d91248c46148 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:25:45 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] VM Resumed (Lifecycle Event)
Aug 15 07:25:45 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Instance running successfully.
Aug 15 07:25:45 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Instance soft rebooted successfully.
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] No waiting events found dispatching network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:45 user nova-compute[72803]: WARNING nova.compute.manager [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received unexpected event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 for instance with vm_state active and task_state reboot_started.
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] No waiting events found dispatching network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:25:45 user nova-compute[72803]: WARNING nova.compute.manager [req-eaff5de0-62b8-4667-a5ff-1cef4d603668 req-d8bc0d4e-038b-43a4-aab8-2a938207e845 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received unexpected event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 for instance with vm_state active and task_state reboot_started.
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:25:45 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084345.0139093, 2856a984-0b77-4f9a-9967-d91248c46148 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:25:45 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] VM Started (Lifecycle Event)
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:25:45 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40715983-fe62-4bec-9e54-ed3ccce76b2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.422s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:25:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:51 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:53 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:54 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:55 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:55 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:55 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:25:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:25:59 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:25:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:26:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:26:02 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:26:02 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8189MB free_disk=25.174407958984375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:26:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 26375ab8-3a94-45e6-b847-1d4d707a6450 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4689e7e1-47e5-435f-b0f2-32327f955285 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 2856a984-0b77-4f9a-9967-d91248c46148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:26:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updating instance_info_cache with network_info: [{"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-26375ab8-3a94-45e6-b847-1d4d707a6450" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:26:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "26375ab8-3a94-45e6-b847-1d4d707a6450" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:26:09 user nova-compute[72803]: INFO nova.compute.manager [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Terminating instance
Aug 15 07:26:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-56ae7a4f-7620-43e6-95ff-5bf356231537 req-d8388a21-c3b2-451a-a800-4a161a06bad3 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received event network-vif-unplugged-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-56ae7a4f-7620-43e6-95ff-5bf356231537 req-d8388a21-c3b2-451a-a800-4a161a06bad3 service nova] Acquiring lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-56ae7a4f-7620-43e6-95ff-5bf356231537 req-d8388a21-c3b2-451a-a800-4a161a06bad3 service nova] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-56ae7a4f-7620-43e6-95ff-5bf356231537 req-d8388a21-c3b2-451a-a800-4a161a06bad3 service nova] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-56ae7a4f-7620-43e6-95ff-5bf356231537 req-d8388a21-c3b2-451a-a800-4a161a06bad3 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] No waiting events found dispatching network-vif-unplugged-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-56ae7a4f-7620-43e6-95ff-5bf356231537 req-d8388a21-c3b2-451a-a800-4a161a06bad3 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received event network-vif-unplugged-01998840-baea-46ef-a91e-8967cb8ad9ab for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:26:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Instance destroyed successfully.
Aug 15 07:26:10 user nova-compute[72803]: DEBUG nova.objects.instance [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'resources' on Instance uuid 26375ab8-3a94-45e6-b847-1d4d707a6450 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1133712799',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1133712799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1133712799',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrh47qtRNmSJ2v4pByrzK3gzjYGoatdFMEaSIpnFReY+ZiinG69sSpqvZas5Q2MYrDM0wDXnQzdJOvuhk/8FJhHQxVPrx8yN4JS1rEfo8GU0d/6SOytUbaX/z1tIhvIhg==',key_name='tempest-keypair-1472623624',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-wt1dqvtv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='962292c4846b4ceab2cb00867135e136',uuid=26375ab8-3a94-45e6-b847-1d4d707a6450,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "01998840-baea-46ef-a91e-8967cb8ad9ab", "address": "fa:16:3e:b6:86:f5", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01998840-ba", "ovs_interfaceid": "01998840-baea-46ef-a91e-8967cb8ad9ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:86:f5,bridge_name='br-int',has_traffic_filtering=True,id=01998840-baea-46ef-a91e-8967cb8ad9ab,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01998840-ba') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_vif [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:86:f5,bridge_name='br-int',has_traffic_filtering=True,id=01998840-baea-46ef-a91e-8967cb8ad9ab,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01998840-ba') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01998840-ba, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:26:10 user nova-compute[72803]: INFO os_vif [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:86:f5,bridge_name='br-int',has_traffic_filtering=True,id=01998840-baea-46ef-a91e-8967cb8ad9ab,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01998840-ba')
Aug 15 07:26:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHyqAUop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:26:10 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0126c45b-a4ac-48e4-b977-4dd53e510884]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c81b6e-9776-4301-913f-5bde4a474a6e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:26:10 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:26:10 user nova-compute[72803]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:26:10 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f (non-flash)
Aug 15 07:26:10 user nova-compute[72803]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:26:10 user nova-compute[72803]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:26:10 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e0607250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd49accb-dbfa-4b0a-812b-f70e1e36a123]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba33b9ee-23b3-480e-be59-7ffac9e8acbf]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67404ed-925a-431f-9244-bbd20c0a06ec]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6147c95f-afbb-45c2-ba7a-c571c02931ab]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[85199e2e-0057-4490-9a02-3c178d05b1e4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[96504fb8-f5ad-4330-b175-d614bd01a587]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f, portal: 172.16.0.220,3260]
Aug 15 07:26:10 user nova-compute[72803]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f, portal: 172.16.0.220,3260] successful.
Aug 15 07:26:10 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76825800-dd29-4ac2-ad92-1c5d8f03523f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f01a4f2-0383-4992-a62d-5f92e61c1987]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== disconnect_volume: return (302ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:26:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Deleting instance files /opt/stack/data/nova/instances/26375ab8-3a94-45e6-b847-1d4d707a6450_del
Aug 15 07:26:10 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Deletion of /opt/stack/data/nova/instances/26375ab8-3a94-45e6-b847-1d4d707a6450_del complete
Aug 15 07:26:10 user nova-compute[72803]: INFO nova.compute.manager [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 15 07:26:10 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:11 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:26:11 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Took 0.73 seconds to deallocate network for instance.
Aug 15 07:26:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-25be28e9-e8ba-4d7b-b2bb-f74a52b45b68 req-d3aff5f9-482f-4f38-b39c-49efb3cfd450 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received event network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:26:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-25be28e9-e8ba-4d7b-b2bb-f74a52b45b68 req-d3aff5f9-482f-4f38-b39c-49efb3cfd450 service nova] Acquiring lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:26:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-25be28e9-e8ba-4d7b-b2bb-f74a52b45b68 req-d3aff5f9-482f-4f38-b39c-49efb3cfd450 service nova] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:26:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-25be28e9-e8ba-4d7b-b2bb-f74a52b45b68 req-d3aff5f9-482f-4f38-b39c-49efb3cfd450 service nova] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:26:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-25be28e9-e8ba-4d7b-b2bb-f74a52b45b68 req-d3aff5f9-482f-4f38-b39c-49efb3cfd450 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] No waiting events found dispatching network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:26:11 user nova-compute[72803]: WARNING nova.compute.manager [req-25be28e9-e8ba-4d7b-b2bb-f74a52b45b68 req-d3aff5f9-482f-4f38-b39c-49efb3cfd450 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received unexpected event network-vif-plugged-01998840-baea-46ef-a91e-8967cb8ad9ab for instance with vm_state active and task_state deleting.
Aug 15 07:26:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-25be28e9-e8ba-4d7b-b2bb-f74a52b45b68 req-d3aff5f9-482f-4f38-b39c-49efb3cfd450 service nova] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Received event network-vif-deleted-01998840-baea-46ef-a91e-8967cb8ad9ab {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:26:12 user nova-compute[72803]: INFO nova.compute.manager [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Took 0.78 seconds to detach 1 volumes for instance.
Aug 15 07:26:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Deleting volume: 76825800-dd29-4ac2-ad92-1c5d8f03523f {{(pid=72803) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 07:26:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:26:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:26:12 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:26:12 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:26:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:26:12 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Deleted allocations for instance 26375ab8-3a94-45e6-b847-1d4d707a6450
Aug 15 07:26:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-d90c06a7-2f49-4af4-b546-0e8bfbc96202 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "26375ab8-3a94-45e6-b847-1d4d707a6450" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.179s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:26:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:25 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084370.0939398, 26375ab8-3a94-45e6-b847-1d4d707a6450 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:26:25 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] VM Stopped (Lifecycle Event)
Aug 15 07:26:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e10f5b3f-1e3f-4733-aac8-b1d0ebd6a952 None None] [instance: 26375ab8-3a94-45e6-b847-1d4d707a6450] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:26:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:26:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:26:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:26:51 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:26:53 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:26:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:26:56 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:26:56 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:26:56 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:27:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:27:03 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:27:03 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:27:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=25.173133850097656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4689e7e1-47e5-435f-b0f2-32327f955285 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 2856a984-0b77-4f9a-9967-d91248c46148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:27:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:27:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:27:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:27:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:27:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:27:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:27:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:27:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:27:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:27:10 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:27:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "44561486-52fb-466d-9b1f-59e7fbf79ae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:27:12 user nova-compute[72803]: INFO nova.compute.claims [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Claim successful on node user
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:27:12 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.policy [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '962292c4846b4ceab2cb00867135e136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9714fffd91c94d79aaa288d93fdfaffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:27:12 user nova-compute[72803]: INFO nova.virt.block_device [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Booting with volume 7850018b-961e-4b7e-bc3c-92f2a09e1f90 at /dev/vda
Aug 15 07:27:12 user nova-compute[72803]: DEBUG os_brick.utils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6718f233-449c-4644-87ca-af9f6c58f485]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e783cd5-2a0a-4cb9-a40d-c228f41945e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[50efeced-afd8-4121-8676-b0e5a2848eb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ad6fb3-2dca-4e4b-8577-b644ef67c67e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:27:12 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:27:12 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c13185-3705-421e-9c67-b5ff163d7402]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG os_brick.utils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:27:12 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Updating existing volume attachment record: 25db5b9a-6833-460c-a777-de1f6e6d85b1 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:27:13 user nova-compute[72803]: DEBUG nova.network.neutron [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Successfully created port: f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG nova.network.neutron [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Successfully updated port: f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquired lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG nova.network.neutron [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-c50fcb24-3bf3-4872-8c6c-8134231d1c7e req-77389162-81c0-466d-8861-495c91aac348 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received event network-changed-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-c50fcb24-3bf3-4872-8c6c-8134231d1c7e req-77389162-81c0-466d-8861-495c91aac348 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Refreshing instance network info cache due to event network-changed-f5e5bfd0-e7d9-442b-a625-a50cee51bca6. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c50fcb24-3bf3-4872-8c6c-8134231d1c7e req-77389162-81c0-466d-8861-495c91aac348 service nova] Acquiring lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG nova.network.neutron [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG nova.network.neutron [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Updating instance_info_cache with network_info: [{"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Releasing lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Instance network_info: |[{"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c50fcb24-3bf3-4872-8c6c-8134231d1c7e req-77389162-81c0-466d-8861-495c91aac348 service nova] Acquired lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:27:14 user nova-compute[72803]: DEBUG nova.network.neutron [req-c50fcb24-3bf3-4872-8c6c-8134231d1c7e req-77389162-81c0-466d-8861-495c91aac348 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Refreshing network info cache for port f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:27:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:15 user nova-compute[72803]: DEBUG nova.network.neutron [req-c50fcb24-3bf3-4872-8c6c-8134231d1c7e req-77389162-81c0-466d-8861-495c91aac348 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Updated VIF entry in instance network info cache for port f5e5bfd0-e7d9-442b-a625-a50cee51bca6. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:27:15 user nova-compute[72803]: DEBUG nova.network.neutron [req-c50fcb24-3bf3-4872-8c6c-8134231d1c7e req-77389162-81c0-466d-8861-495c91aac348 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Updating instance_info_cache with network_info: [{"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:27:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c50fcb24-3bf3-4872-8c6c-8134231d1c7e req-77389162-81c0-466d-8861-495c91aac348 service nova] Releasing lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:27:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-2a3d58fd-e97c-4a38-8d43-5fc235824270 req-af509cc3-092d-4900-aaf9-77023b58b8bc service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-changed-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:27:19 user nova-compute[72803]: DEBUG nova.compute.manager [req-2a3d58fd-e97c-4a38-8d43-5fc235824270 req-af509cc3-092d-4900-aaf9-77023b58b8bc service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Refreshing instance network info cache due to event network-changed-067aa359-e89d-413f-b75e-54e39ef2d8c0. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:27:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a3d58fd-e97c-4a38-8d43-5fc235824270 req-af509cc3-092d-4900-aaf9-77023b58b8bc service nova] Acquiring lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:27:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a3d58fd-e97c-4a38-8d43-5fc235824270 req-af509cc3-092d-4900-aaf9-77023b58b8bc service nova] Acquired lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:27:19 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a3d58fd-e97c-4a38-8d43-5fc235824270 req-af509cc3-092d-4900-aaf9-77023b58b8bc service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Refreshing network info cache for port 067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:27:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:20 user nova-compute[72803]: INFO nova.compute.manager [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Detaching volume 1f9ee06a-61e9-4a60-9dae-7b248d2bcce8
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a3d58fd-e97c-4a38-8d43-5fc235824270 req-af509cc3-092d-4900-aaf9-77023b58b8bc service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updated VIF entry in instance network info cache for port 067aa359-e89d-413f-b75e-54e39ef2d8c0. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.network.neutron [req-2a3d58fd-e97c-4a38-8d43-5fc235824270 req-af509cc3-092d-4900-aaf9-77023b58b8bc service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2a3d58fd-e97c-4a38-8d43-5fc235824270 req-af509cc3-092d-4900-aaf9-77023b58b8bc service nova] Releasing lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:27:20 user nova-compute[72803]: INFO nova.virt.block_device [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Attempting to driver detach volume 1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 from mountpoint /dev/vdb
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Attempting to detach device vdb from instance 4689e7e1-47e5-435f-b0f2-32327f955285 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:27:20 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:27:20 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:27:20 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:27:20 user nova-compute[72803]:   <serial>1f9ee06a-61e9-4a60-9dae-7b248d2bcce8</serial>
Aug 15 07:27:20 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:27:20 user nova-compute[72803]: </disk>
Aug 15 07:27:20 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:27:20 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Successfully detached device vdb from instance 4689e7e1-47e5-435f-b0f2-32327f955285 from the persistent domain config.
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4689e7e1-47e5-435f-b0f2-32327f955285 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:27:20 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:27:20 user nova-compute[72803]:   <source dev="/dev/sdc"/>
Aug 15 07:27:20 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:27:20 user nova-compute[72803]:   <serial>1f9ee06a-61e9-4a60-9dae-7b248d2bcce8</serial>
Aug 15 07:27:20 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:27:20 user nova-compute[72803]: </disk>
Aug 15 07:27:20 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692084440.7858446, 4689e7e1-47e5-435f-b0f2-32327f955285 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:27:20 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Successfully detached device vdb from instance 4689e7e1-47e5-435f-b0f2-32327f955285 from the live domain config.
Aug 15 07:27:20 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnGTpvSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:27:20 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[df093c85-09df-4e15-8395-9cf365c8322d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[65870e32-8c31-40f0-8c63-3cc3a1d675a3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:27:20 user nova-compute[72803]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:27:20 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 (non-flash)
Aug 15 07:27:20 user nova-compute[72803]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:27:20 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34e0422d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0570c8-c70e-4b42-9ac5-6ef3f3cd1ddc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d96d317-3f1a-4ff5-9365-595fdbfd90c8]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eefd7c5-77fa-4e15-8d49-5685825d142c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[162eb97f-df0e-4a75-ae2b-d8cdda58956f]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c29fe6-6b58-41d3-8aa7-94cd2c906a16]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a3a701-e1e2-471c-b23f-301ac9eaf4cb]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8, portal: 172.16.0.220,3260]
Aug 15 07:27:21 user nova-compute[72803]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8, portal: 172.16.0.220,3260] successful.
Aug 15 07:27:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f9ee06a-61e9-4a60-9dae-7b248d2bcce8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea62fc9b-5f89-4000-aa8d-5b64291b8f6a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] <== disconnect_volume: return (273ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'flavor' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2286766e-7ce0-4aed-8682-0082f830bea7 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.610s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-07b9a4a6-112d-4443-9aec-f5b2fac6efad req-2457ae77-74cb-42aa-8a72-34c6bbae3b6b service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-changed-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.compute.manager [req-07b9a4a6-112d-4443-9aec-f5b2fac6efad req-2457ae77-74cb-42aa-8a72-34c6bbae3b6b service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Refreshing instance network info cache due to event network-changed-067aa359-e89d-413f-b75e-54e39ef2d8c0. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-07b9a4a6-112d-4443-9aec-f5b2fac6efad req-2457ae77-74cb-42aa-8a72-34c6bbae3b6b service nova] Acquiring lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-07b9a4a6-112d-4443-9aec-f5b2fac6efad req-2457ae77-74cb-42aa-8a72-34c6bbae3b6b service nova] Acquired lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.network.neutron [req-07b9a4a6-112d-4443-9aec-f5b2fac6efad req-2457ae77-74cb-42aa-8a72-34c6bbae3b6b service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Refreshing network info cache for port 067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:27:21 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Creating image(s)
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Ensure instance console log exists: /opt/stack/data/nova/instances/44561486-52fb-466d-9b1f-59e7fbf79ae8/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Start _get_guest_xml network_info=[{"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '25db5b9a-6833-460c-a777-de1f6e6d85b1', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhWJGwvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44561486-52fb-466d-9b1f-59e7fbf79ae8', 'attached_at': '', 'detached_at': '', 'volume_id': '7850018b-961e-4b7e-bc3c-92f2a09e1f90', 'serial': '7850018b-961e-4b7e-bc3c-92f2a09e1f90'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:27:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:27:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhWJGwvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:27:21 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:27:21 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:27:21 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcdb982-e371-4319-b582-a94b0c803cec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:27:21 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7912fb3e-ad39-4826-812a-119acf4d674a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90] added
Aug 15 07:27:21 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:21 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[176341d4-9dac-4be2-9afb-2aeabd4d0a8a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d087f5-773b-4c07-bd13-ab1a47056cc1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mhWJGwvx {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mhWJGwvx" returned: 0 in 0.029s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c4de34-85db-4340-8776-21d2b10a8cf9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mhWJGwvx'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aa55a5-73e2-4096-9174-5ce0db5db62d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb8be47-5138-469f-a930-7f9a2b9bdc9d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:27:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:27:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[819a35bd-eb32-4d87-9379-e36d6a4f17c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260]
Aug 15 07:27:22 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260] successful.
Aug 15 07:27:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8c3500-fbd4-453e-8ee5-4882e3f6fc25]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e742cb4c-6ab5-4e8a-84c2-1d9d105bd951]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:27:22 user nova-compute[72803]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:27:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:27:22 user nova-compute[72803]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:27:22 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0407eba-3a2c-483a-9e55-fde5dd9914e7]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhWJGwvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG nova.network.neutron [req-07b9a4a6-112d-4443-9aec-f5b2fac6efad req-2457ae77-74cb-42aa-8a72-34c6bbae3b6b service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updated VIF entry in instance network info cache for port 067aa359-e89d-413f-b75e-54e39ef2d8c0. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG nova.network.neutron [req-07b9a4a6-112d-4443-9aec-f5b2fac6efad req-2457ae77-74cb-42aa-8a72-34c6bbae3b6b service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [{"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:27:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-07b9a4a6-112d-4443-9aec-f5b2fac6efad req-2457ae77-74cb-42aa-8a72-34c6bbae3b6b service nova] Releasing lock "refresh_cache-4689e7e1-47e5-435f-b0f2-32327f955285" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23939343532663066', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939343532663066', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-394840072',display_name='tempest-TestVolumeBootPattern-server-394840072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-394840072',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-z03upwis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:27:13Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=44561486-52fb-466d-9b1f-59e7fbf79ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:1a,bridge_name='br-int',has_traffic_filtering=True,id=f5e5bfd0-e7d9-442b-a625-a50cee51bca6,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e5bfd0-e7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'pci_devices' on Instance uuid 44561486-52fb-466d-9b1f-59e7fbf79ae8 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:27:23 user nova-compute[72803]:   <uuid>44561486-52fb-466d-9b1f-59e7fbf79ae8</uuid>
Aug 15 07:27:23 user nova-compute[72803]:   <name>instance-0000002f</name>
Aug 15 07:27:23 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:27:23 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:27:23 user nova-compute[72803]:   <metadata>
Aug 15 07:27:23 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:27:23 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:27:23 user nova-compute[72803]:       <nova:name>tempest-TestVolumeBootPattern-server-394840072</nova:name>
Aug 15 07:27:23 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:27:21</nova:creationTime>
Aug 15 07:27:23 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:27:23 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:27:23 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:27:23 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:27:23 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:27:23 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:27:23 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:27:23 user nova-compute[72803]:       <nova:owner>
Aug 15 07:27:23 user nova-compute[72803]:         <nova:user uuid="962292c4846b4ceab2cb00867135e136">tempest-TestVolumeBootPattern-940544162-project-member</nova:user>
Aug 15 07:27:23 user nova-compute[72803]:         <nova:project uuid="9714fffd91c94d79aaa288d93fdfaffa">tempest-TestVolumeBootPattern-940544162</nova:project>
Aug 15 07:27:23 user nova-compute[72803]:       </nova:owner>
Aug 15 07:27:23 user nova-compute[72803]:       <nova:ports>
Aug 15 07:27:23 user nova-compute[72803]:         <nova:port uuid="f5e5bfd0-e7d9-442b-a625-a50cee51bca6">
Aug 15 07:27:23 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:27:23 user nova-compute[72803]:         </nova:port>
Aug 15 07:27:23 user nova-compute[72803]:       </nova:ports>
Aug 15 07:27:23 user nova-compute[72803]:     </nova:instance>
Aug 15 07:27:23 user nova-compute[72803]:   </metadata>
Aug 15 07:27:23 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:27:23 user nova-compute[72803]:     <system>
Aug 15 07:27:23 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:27:23 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:27:23 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:27:23 user nova-compute[72803]:       <entry name="serial">44561486-52fb-466d-9b1f-59e7fbf79ae8</entry>
Aug 15 07:27:23 user nova-compute[72803]:       <entry name="uuid">44561486-52fb-466d-9b1f-59e7fbf79ae8</entry>
Aug 15 07:27:23 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:27:23 user nova-compute[72803]:     </system>
Aug 15 07:27:23 user nova-compute[72803]:   </sysinfo>
Aug 15 07:27:23 user nova-compute[72803]:   <os>
Aug 15 07:27:23 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:27:23 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:27:23 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:27:23 user nova-compute[72803]:   </os>
Aug 15 07:27:23 user nova-compute[72803]:   <features>
Aug 15 07:27:23 user nova-compute[72803]:     <acpi/>
Aug 15 07:27:23 user nova-compute[72803]:     <apic/>
Aug 15 07:27:23 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:27:23 user nova-compute[72803]:   </features>
Aug 15 07:27:23 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:27:23 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:27:23 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:27:23 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:27:23 user nova-compute[72803]:   </clock>
Aug 15 07:27:23 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:27:23 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:27:23 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:27:23 user nova-compute[72803]:   </cpu>
Aug 15 07:27:23 user nova-compute[72803]:   <devices>
Aug 15 07:27:23 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:27:23 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:27:23 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 07:27:23 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:27:23 user nova-compute[72803]:       <serial>7850018b-961e-4b7e-bc3c-92f2a09e1f90</serial>
Aug 15 07:27:23 user nova-compute[72803]:     </disk>
Aug 15 07:27:23 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:27:23 user nova-compute[72803]:       <mac address="fa:16:3e:11:17:1a"/>
Aug 15 07:27:23 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:27:23 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:27:23 user nova-compute[72803]:       <target dev="tapf5e5bfd0-e7"/>
Aug 15 07:27:23 user nova-compute[72803]:     </interface>
Aug 15 07:27:23 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:27:23 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/44561486-52fb-466d-9b1f-59e7fbf79ae8/console.log" append="off"/>
Aug 15 07:27:23 user nova-compute[72803]:     </serial>
Aug 15 07:27:23 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:27:23 user nova-compute[72803]:     <video>
Aug 15 07:27:23 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:27:23 user nova-compute[72803]:     </video>
Aug 15 07:27:23 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:27:23 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:27:23 user nova-compute[72803]:     </rng>
Aug 15 07:27:23 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:27:23 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:27:23 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:27:23 user nova-compute[72803]:     </memballoon>
Aug 15 07:27:23 user nova-compute[72803]:   </devices>
Aug 15 07:27:23 user nova-compute[72803]: </domain>
Aug 15 07:27:23 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-394840072',display_name='tempest-TestVolumeBootPattern-server-394840072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-394840072',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-z03upwis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:27:13Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=44561486-52fb-466d-9b1f-59e7fbf79ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:1a,bridge_name='br-int',has_traffic_filtering=True,id=f5e5bfd0-e7d9-442b-a625-a50cee51bca6,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e5bfd0-e7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG os_vif [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:1a,bridge_name='br-int',has_traffic_filtering=True,id=f5e5bfd0-e7d9-442b-a625-a50cee51bca6,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e5bfd0-e7') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e5bfd0-e7, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5e5bfd0-e7, col_values=(('external_ids', {'iface-id': 'f5e5bfd0-e7d9-442b-a625-a50cee51bca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:17:1a', 'vm-uuid': '44561486-52fb-466d-9b1f-59e7fbf79ae8'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:23 user nova-compute[72803]: INFO os_vif [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:1a,bridge_name='br-int',has_traffic_filtering=True,id=f5e5bfd0-e7d9-442b-a625-a50cee51bca6,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e5bfd0-e7')
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:27:23 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No VIF found with MAC fa:16:3e:11:17:1a, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:27:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-14f4e4f9-c824-465d-b9d6-a9e1556fcf94 req-e5c26b3c-0f64-4ed2-a586-eecd90656f41 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received event network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:27:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-14f4e4f9-c824-465d-b9d6-a9e1556fcf94 req-e5c26b3c-0f64-4ed2-a586-eecd90656f41 service nova] Acquiring lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-14f4e4f9-c824-465d-b9d6-a9e1556fcf94 req-e5c26b3c-0f64-4ed2-a586-eecd90656f41 service nova] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-14f4e4f9-c824-465d-b9d6-a9e1556fcf94 req-e5c26b3c-0f64-4ed2-a586-eecd90656f41 service nova] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:24 user nova-compute[72803]: DEBUG nova.compute.manager [req-14f4e4f9-c824-465d-b9d6-a9e1556fcf94 req-e5c26b3c-0f64-4ed2-a586-eecd90656f41 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] No waiting events found dispatching network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:27:24 user nova-compute[72803]: WARNING nova.compute.manager [req-14f4e4f9-c824-465d-b9d6-a9e1556fcf94 req-e5c26b3c-0f64-4ed2-a586-eecd90656f41 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received unexpected event network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 for instance with vm_state building and task_state spawning.
Aug 15 07:27:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084446.7144508, 44561486-52fb-466d-9b1f-59e7fbf79ae8 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:27:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] VM Resumed (Lifecycle Event)
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:27:26 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Instance spawned successfully.
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:27:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084446.7154658, 44561486-52fb-466d-9b1f-59e7fbf79ae8 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:27:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] VM Started (Lifecycle Event)
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:27:26 user nova-compute[72803]: INFO nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:27:26 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-2c7dbbda-b3f6-4bfa-b0c2-93e68f20719d req-95f3fa88-671e-4feb-8d9e-68e99f592d9c service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received event network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2c7dbbda-b3f6-4bfa-b0c2-93e68f20719d req-95f3fa88-671e-4feb-8d9e-68e99f592d9c service nova] Acquiring lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2c7dbbda-b3f6-4bfa-b0c2-93e68f20719d req-95f3fa88-671e-4feb-8d9e-68e99f592d9c service nova] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2c7dbbda-b3f6-4bfa-b0c2-93e68f20719d req-95f3fa88-671e-4feb-8d9e-68e99f592d9c service nova] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:26 user nova-compute[72803]: DEBUG nova.compute.manager [req-2c7dbbda-b3f6-4bfa-b0c2-93e68f20719d req-95f3fa88-671e-4feb-8d9e-68e99f592d9c service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] No waiting events found dispatching network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:27:26 user nova-compute[72803]: WARNING nova.compute.manager [req-2c7dbbda-b3f6-4bfa-b0c2-93e68f20719d req-95f3fa88-671e-4feb-8d9e-68e99f592d9c service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received unexpected event network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 for instance with vm_state building and task_state spawning.
Aug 15 07:27:26 user nova-compute[72803]: INFO nova.compute.manager [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Took 14.68 seconds to build instance.
Aug 15 07:27:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-61a02cb4-b58d-4477-928f-df56bed812af tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.769s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-66fa9352-18c6-4d76-942f-416e5ffa0f8c req-99f893c9-4994-4110-a210-ce4c6bb67523 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:27:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-66fa9352-18c6-4d76-942f-416e5ffa0f8c req-99f893c9-4994-4110-a210-ce4c6bb67523 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing instance network info cache due to event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:27:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-66fa9352-18c6-4d76-942f-416e5ffa0f8c req-99f893c9-4994-4110-a210-ce4c6bb67523 service nova] Acquiring lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:27:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-66fa9352-18c6-4d76-942f-416e5ffa0f8c req-99f893c9-4994-4110-a210-ce4c6bb67523 service nova] Acquired lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:27:29 user nova-compute[72803]: DEBUG nova.network.neutron [req-66fa9352-18c6-4d76-942f-416e5ffa0f8c req-99f893c9-4994-4110-a210-ce4c6bb67523 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:27:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-66fa9352-18c6-4d76-942f-416e5ffa0f8c req-99f893c9-4994-4110-a210-ce4c6bb67523 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updated VIF entry in instance network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:27:30 user nova-compute[72803]: DEBUG nova.network.neutron [req-66fa9352-18c6-4d76-942f-416e5ffa0f8c req-99f893c9-4994-4110-a210-ce4c6bb67523 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:27:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-66fa9352-18c6-4d76-942f-416e5ffa0f8c req-99f893c9-4994-4110-a210-ce4c6bb67523 service nova] Releasing lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:27:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:27:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:27:30 user nova-compute[72803]: INFO nova.compute.manager [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Detaching volume ab4c68d4-e422-4305-b1b9-e68a535a175b
Aug 15 07:27:30 user nova-compute[72803]: INFO nova.virt.block_device [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Attempting to driver detach volume ab4c68d4-e422-4305-b1b9-e68a535a175b from mountpoint /dev/vdb
Aug 15 07:27:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Attempting to detach device vdb from instance 2856a984-0b77-4f9a-9967-d91248c46148 from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:27:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:27:30 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:27:30 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:27:30 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:27:30 user nova-compute[72803]:   <serial>ab4c68d4-e422-4305-b1b9-e68a535a175b</serial>
Aug 15 07:27:30 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:27:30 user nova-compute[72803]: </disk>
Aug 15 07:27:30 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:27:30 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully detached device vdb from instance 2856a984-0b77-4f9a-9967-d91248c46148 from the persistent domain config.
Aug 15 07:27:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2856a984-0b77-4f9a-9967-d91248c46148 from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:27:30 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:27:30 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:27:30 user nova-compute[72803]:   <source dev="/dev/sdd"/>
Aug 15 07:27:30 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:27:30 user nova-compute[72803]:   <serial>ab4c68d4-e422-4305-b1b9-e68a535a175b</serial>
Aug 15 07:27:30 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:27:30 user nova-compute[72803]: </disk>
Aug 15 07:27:30 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692084451.2639556, 2856a984-0b77-4f9a-9967-d91248c46148 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2856a984-0b77-4f9a-9967-d91248c46148 {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:27:31 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully detached device vdb from instance 2856a984-0b77-4f9a-9967-d91248c46148 from the live domain config.
Aug 15 07:27:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVgXjEAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:27:31 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[389e5bdf-3397-4fd3-9c46-a49ad6f50d79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5b2a31-4c8c-436a-a6ef-504d74f335c8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:27:31 user nova-compute[72803]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:27:31 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b (non-flash)
Aug 15 07:27:31 user nova-compute[72803]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:27:31 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f350f4632e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b'): ({'sdd'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Removing single pathed devices sdd {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f27a4da-df06-405b-bda8-9b8ff67b45fe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[566b3b69-8c02-42de-b267-5fd599ad774e]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Flushing IO for device /dev/sdd {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79d7b60-c630-4701-a342-63c991de9905]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[837ff7c4-29a3-4b1f-8ca0-a8454db3dc8c]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] SCSI volumes sdd have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b575f788-97da-4254-b66d-eb22347a4a5d]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c732603f-5387-410f-bab3-5bda9696521c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b, portal: 172.16.0.220,3260]
Aug 15 07:27:31 user nova-compute[72803]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b, portal: 172.16.0.220,3260] successful.
Aug 15 07:27:31 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4c68d4-e422-4305-b1b9-e68a535a175b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f240fe6-f7ab-487a-bacb-05227c5242ac]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] <== disconnect_volume: return (272ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-c98b8a7f-bf99-43fe-9aa9-d1736682627f req-6123d60f-0bcd-483d-ab28-2e422c14923a service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-c98b8a7f-bf99-43fe-9aa9-d1736682627f req-6123d60f-0bcd-483d-ab28-2e422c14923a service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing instance network info cache due to event network-changed-6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c98b8a7f-bf99-43fe-9aa9-d1736682627f req-6123d60f-0bcd-483d-ab28-2e422c14923a service nova] Acquiring lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c98b8a7f-bf99-43fe-9aa9-d1736682627f req-6123d60f-0bcd-483d-ab28-2e422c14923a service nova] Acquired lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:27:31 user nova-compute[72803]: DEBUG nova.network.neutron [req-c98b8a7f-bf99-43fe-9aa9-d1736682627f req-6123d60f-0bcd-483d-ab28-2e422c14923a service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Refreshing network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:27:32 user nova-compute[72803]: DEBUG nova.network.neutron [req-c98b8a7f-bf99-43fe-9aa9-d1736682627f req-6123d60f-0bcd-483d-ab28-2e422c14923a service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updated VIF entry in instance network info cache for port 6717565a-7ce8-40d6-a04b-bd43f2375ed8. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:27:32 user nova-compute[72803]: DEBUG nova.network.neutron [req-c98b8a7f-bf99-43fe-9aa9-d1736682627f req-6123d60f-0bcd-483d-ab28-2e422c14923a service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:27:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c98b8a7f-bf99-43fe-9aa9-d1736682627f req-6123d60f-0bcd-483d-ab28-2e422c14923a service nova] Releasing lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:27:32 user nova-compute[72803]: DEBUG nova.objects.instance [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'flavor' on Instance uuid 2856a984-0b77-4f9a-9967-d91248c46148 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:27:32 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-a1ac0c65-b2f1-43f3-a16f-d138bcfe8a2e tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.620s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:27:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:27:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:50 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:53 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:55 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:27:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:27:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:01 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:28:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:28:03 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:28:03 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:28:03 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8315MB free_disk=25.16284942626953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:28:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 4689e7e1-47e5-435f-b0f2-32327f955285 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 2856a984-0b77-4f9a-9967-d91248c46148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 44561486-52fb-466d-9b1f-59e7fbf79ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:28:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:28:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:28:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:28:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:28:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:28:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [{"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:28:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-2856a984-0b77-4f9a-9967-d91248c46148" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:28:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:28:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:28:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:28:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:28:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:10 user nova-compute[72803]: INFO nova.compute.manager [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Terminating instance
Aug 15 07:28:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-c63a6e17-ebc2-4fc4-9262-20d0254a0ae9 req-ebe976e5-7308-4d1e-af15-9b99594a9a86 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c63a6e17-ebc2-4fc4-9262-20d0254a0ae9 req-ebe976e5-7308-4d1e-af15-9b99594a9a86 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c63a6e17-ebc2-4fc4-9262-20d0254a0ae9 req-ebe976e5-7308-4d1e-af15-9b99594a9a86 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c63a6e17-ebc2-4fc4-9262-20d0254a0ae9 req-ebe976e5-7308-4d1e-af15-9b99594a9a86 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-c63a6e17-ebc2-4fc4-9262-20d0254a0ae9 req-ebe976e5-7308-4d1e-af15-9b99594a9a86 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG nova.compute.manager [req-c63a6e17-ebc2-4fc4-9262-20d0254a0ae9 req-ebe976e5-7308-4d1e-af15-9b99594a9a86 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-unplugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Instance destroyed successfully.
Aug 15 07:28:11 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'resources' on Instance uuid 4689e7e1-47e5-435f-b0f2-32327f955285 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-218054654',display_name='tempest-ServerRescueNegativeTestJSON-server-218054654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-218054654',id=44,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQoL7M/7lnh5ItsBC6ALybOX/qAelb5zwvWOrtJfhGWPzbxUVb8Z044Dfm1/KTq1HuH+P/Zt8jQNokZ+L/cPHpZ+AR8Swrzeg15f6ft03NqW1hZRn+lz8vFgJfj10yUzg==',key_name='tempest-keypair-775720222',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-vjnaaghm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cf4a499a9d54262bd8959b87918717c',uuid=4689e7e1-47e5-435f-b0f2-32327f955285,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "address": "fa:16:3e:af:99:3e", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067aa359-e8", "ovs_interfaceid": "067aa359-e89d-413f-b75e-54e39ef2d8c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:99:3e,bridge_name='br-int',has_traffic_filtering=True,id=067aa359-e89d-413f-b75e-54e39ef2d8c0,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067aa359-e8') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG os_vif [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:99:3e,bridge_name='br-int',has_traffic_filtering=True,id=067aa359-e89d-413f-b75e-54e39ef2d8c0,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067aa359-e8') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap067aa359-e8, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:11 user nova-compute[72803]: INFO os_vif [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:99:3e,bridge_name='br-int',has_traffic_filtering=True,id=067aa359-e89d-413f-b75e-54e39ef2d8c0,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067aa359-e8')
Aug 15 07:28:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Deleting instance files /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285_del
Aug 15 07:28:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Deletion of /opt/stack/data/nova/instances/4689e7e1-47e5-435f-b0f2-32327f955285_del complete
Aug 15 07:28:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 07:28:11 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:28:11 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:28:12 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Took 1.04 seconds to deallocate network for instance.
Aug 15 07:28:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-467cf7e9-6581-4b48-b1d5-43e4564e30d5 req-caaed5cc-9bb0-48dc-b73a-76caec229120 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-deleted-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:12 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Deleted allocations for instance 4689e7e1-47e5-435f-b0f2-32327f955285
Aug 15 07:28:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3eb03449-d70f-4754-bffc-00e8f0888747 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "4689e7e1-47e5-435f-b0f2-32327f955285" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-c92619f6-098d-4b38-b8cd-5610050928af req-5253be83-bb7d-435a-a00e-7a289d642810 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c92619f6-098d-4b38-b8cd-5610050928af req-5253be83-bb7d-435a-a00e-7a289d642810 service nova] Acquiring lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c92619f6-098d-4b38-b8cd-5610050928af req-5253be83-bb7d-435a-a00e-7a289d642810 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-c92619f6-098d-4b38-b8cd-5610050928af req-5253be83-bb7d-435a-a00e-7a289d642810 service nova] Lock "4689e7e1-47e5-435f-b0f2-32327f955285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:12 user nova-compute[72803]: DEBUG nova.compute.manager [req-c92619f6-098d-4b38-b8cd-5610050928af req-5253be83-bb7d-435a-a00e-7a289d642810 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] No waiting events found dispatching network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:28:12 user nova-compute[72803]: WARNING nova.compute.manager [req-c92619f6-098d-4b38-b8cd-5610050928af req-5253be83-bb7d-435a-a00e-7a289d642810 service nova] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Received unexpected event network-vif-plugged-067aa359-e89d-413f-b75e-54e39ef2d8c0 for instance with vm_state deleted and task_state None.
Aug 15 07:28:16 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:21 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:26 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084491.382571, 4689e7e1-47e5-435f-b0f2-32327f955285 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:28:26 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] VM Stopped (Lifecycle Event)
Aug 15 07:28:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-681a88dc-1230-4390-9452-011d9e774558 None None] [instance: 4689e7e1-47e5-435f-b0f2-32327f955285] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:28:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:28:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:28:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:28:26 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:27 user nova-compute[72803]: INFO nova.compute.manager [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Terminating instance
Aug 15 07:28:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-227dd9e8-2cd9-47ff-b5a0-4ffa3b32cebf req-4200c0db-688a-45d8-9af3-6972c73959cf service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-unplugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-227dd9e8-2cd9-47ff-b5a0-4ffa3b32cebf req-4200c0db-688a-45d8-9af3-6972c73959cf service nova] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-227dd9e8-2cd9-47ff-b5a0-4ffa3b32cebf req-4200c0db-688a-45d8-9af3-6972c73959cf service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-227dd9e8-2cd9-47ff-b5a0-4ffa3b32cebf req-4200c0db-688a-45d8-9af3-6972c73959cf service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-227dd9e8-2cd9-47ff-b5a0-4ffa3b32cebf req-4200c0db-688a-45d8-9af3-6972c73959cf service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] No waiting events found dispatching network-vif-unplugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:28:27 user nova-compute[72803]: DEBUG nova.compute.manager [req-227dd9e8-2cd9-47ff-b5a0-4ffa3b32cebf req-4200c0db-688a-45d8-9af3-6972c73959cf service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-unplugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:28:28 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Instance destroyed successfully.
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lazy-loading 'resources' on Instance uuid 2856a984-0b77-4f9a-9967-d91248c46148 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696340707',display_name='tempest-TestMinimumBasicScenario-server-1696340707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696340707',id=46,image_ref='43013a29-3a4f-4101-b423-fdfb2a1b0f2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARCz8c0HXJ9KQOFxrgzmjWdRwj2m4bQ8xfFzcY5VE6hNBnCiQ635zRpQw1GcSmyCZAi44XtZoxZFJJKb02Dbu120KcC3JpTXED0AYLrP5GnaLhK93La/jrLm6IFlEeQQQ==',key_name='tempest-TestMinimumBasicScenario-1922874179',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35db591e3ed243128111721ee0e6c276',ramdisk_id='',reservation_id='r-f04azbwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43013a29-3a4f-4101-b423-fdfb2a1b0f2a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1832153355',owner_user_name='tempest-TestMinimumBasicScenario-1832153355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:25:45Z,user_data=None,user_id='76bdfb1f24e5432fbb1946ad1875a8f9',uuid=2856a984-0b77-4f9a-9967-d91248c46148,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converting VIF {"id": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "address": "fa:16:3e:79:6d:19", "network": {"id": "ed639099-92d3-44ef-ae60-ad51f7264ab9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1447400897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35db591e3ed243128111721ee0e6c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6717565a-7c", "ovs_interfaceid": "6717565a-7ce8-40d6-a04b-bd43f2375ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=6717565a-7ce8-40d6-a04b-bd43f2375ed8,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6717565a-7c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG os_vif [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=6717565a-7ce8-40d6-a04b-bd43f2375ed8,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6717565a-7c') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6717565a-7c, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:28 user nova-compute[72803]: INFO os_vif [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=6717565a-7ce8-40d6-a04b-bd43f2375ed8,network=Network(ed639099-92d3-44ef-ae60-ad51f7264ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6717565a-7c')
Aug 15 07:28:28 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Deleting instance files /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148_del
Aug 15 07:28:28 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Deletion of /opt/stack/data/nova/instances/2856a984-0b77-4f9a-9967-d91248c46148_del complete
Aug 15 07:28:28 user nova-compute[72803]: INFO nova.compute.manager [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 07:28:28 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:28:28 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Took 0.54 seconds to deallocate network for instance.
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.compute.manager [req-5e5acf38-ae1e-42a1-acba-38e86b9b0d5b req-c556ae5b-7336-46ea-90e8-50f901babba3 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-deleted-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:28:28 user nova-compute[72803]: INFO nova.compute.manager [req-5e5acf38-ae1e-42a1-acba-38e86b9b0d5b req-c556ae5b-7336-46ea-90e8-50f901babba3 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Neutron deleted interface 6717565a-7ce8-40d6-a04b-bd43f2375ed8; detaching it from the instance and deleting it from the info cache
Aug 15 07:28:28 user nova-compute[72803]: DEBUG nova.network.neutron [req-5e5acf38-ae1e-42a1-acba-38e86b9b0d5b req-c556ae5b-7336-46ea-90e8-50f901babba3 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-5e5acf38-ae1e-42a1-acba-38e86b9b0d5b req-c556ae5b-7336-46ea-90e8-50f901babba3 service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Detach interface failed, port_id=6717565a-7ce8-40d6-a04b-bd43f2375ed8, reason: Instance 2856a984-0b77-4f9a-9967-d91248c46148 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:29 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Deleted allocations for instance 2856a984-0b77-4f9a-9967-d91248c46148
Aug 15 07:28:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e9cffd5d-fe32-4639-895c-68322035cd13 tempest-TestMinimumBasicScenario-1832153355 tempest-TestMinimumBasicScenario-1832153355-project-member] Lock "2856a984-0b77-4f9a-9967-d91248c46148" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.858s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-b8983ab9-99bc-461a-a63f-0ae8b6049c89 req-b2aefb36-c954-4ade-9fe7-66568ceb973a service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b8983ab9-99bc-461a-a63f-0ae8b6049c89 req-b2aefb36-c954-4ade-9fe7-66568ceb973a service nova] Acquiring lock "2856a984-0b77-4f9a-9967-d91248c46148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b8983ab9-99bc-461a-a63f-0ae8b6049c89 req-b2aefb36-c954-4ade-9fe7-66568ceb973a service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-b8983ab9-99bc-461a-a63f-0ae8b6049c89 req-b2aefb36-c954-4ade-9fe7-66568ceb973a service nova] Lock "2856a984-0b77-4f9a-9967-d91248c46148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:28:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-b8983ab9-99bc-461a-a63f-0ae8b6049c89 req-b2aefb36-c954-4ade-9fe7-66568ceb973a service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] No waiting events found dispatching network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:28:29 user nova-compute[72803]: WARNING nova.compute.manager [req-b8983ab9-99bc-461a-a63f-0ae8b6049c89 req-b2aefb36-c954-4ade-9fe7-66568ceb973a service nova] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Received unexpected event network-vif-plugged-6717565a-7ce8-40d6-a04b-bd43f2375ed8 for instance with vm_state deleted and task_state None.
Aug 15 07:28:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:43 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084508.2579734, 2856a984-0b77-4f9a-9967-d91248c46148 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:28:43 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] VM Stopped (Lifecycle Event)
Aug 15 07:28:43 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c512493b-e43d-46c0-8fb7-2521af62dad9 None None] [instance: 2856a984-0b77-4f9a-9967-d91248c46148] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:28:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:28:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:28:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:28:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:28:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:28:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:28:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:52 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:28:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:28:54 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:28:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:28:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:28:59 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:29:01 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:03 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:29:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:29:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:29:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:29:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:29:03 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [{"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-39617700-3648-4f38-b129-0c71584828c9" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-af59b4b7-ad8c-4377-86ca-c44e957c0cd1 req-ef9864cf-239d-43b9-9bad-b5e8d8a59842 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received event network-changed-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-af59b4b7-ad8c-4377-86ca-c44e957c0cd1 req-ef9864cf-239d-43b9-9bad-b5e8d8a59842 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Refreshing instance network info cache due to event network-changed-f5e5bfd0-e7d9-442b-a625-a50cee51bca6. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-af59b4b7-ad8c-4377-86ca-c44e957c0cd1 req-ef9864cf-239d-43b9-9bad-b5e8d8a59842 service nova] Acquiring lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-af59b4b7-ad8c-4377-86ca-c44e957c0cd1 req-ef9864cf-239d-43b9-9bad-b5e8d8a59842 service nova] Acquired lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-af59b4b7-ad8c-4377-86ca-c44e957c0cd1 req-ef9864cf-239d-43b9-9bad-b5e8d8a59842 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Refreshing network info cache for port f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:29:04 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.network.neutron [req-af59b4b7-ad8c-4377-86ca-c44e957c0cd1 req-ef9864cf-239d-43b9-9bad-b5e8d8a59842 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Updated VIF entry in instance network info cache for port f5e5bfd0-e7d9-442b-a625-a50cee51bca6. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.network.neutron [req-af59b4b7-ad8c-4377-86ca-c44e957c0cd1 req-ef9864cf-239d-43b9-9bad-b5e8d8a59842 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Updating instance_info_cache with network_info: [{"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-af59b4b7-ad8c-4377-86ca-c44e957c0cd1 req-ef9864cf-239d-43b9-9bad-b5e8d8a59842 service nova] Releasing lock "refresh_cache-44561486-52fb-466d-9b1f-59e7fbf79ae8" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "44561486-52fb-466d-9b1f-59e7fbf79ae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:05 user nova-compute[72803]: INFO nova.compute.manager [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Terminating instance
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-fefbd235-b20a-491c-8f60-5f7f1f2192b9 req-80f095fd-8d02-47c5-950b-e21e64fbb321 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received event network-vif-unplugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fefbd235-b20a-491c-8f60-5f7f1f2192b9 req-80f095fd-8d02-47c5-950b-e21e64fbb321 service nova] Acquiring lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fefbd235-b20a-491c-8f60-5f7f1f2192b9 req-80f095fd-8d02-47c5-950b-e21e64fbb321 service nova] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fefbd235-b20a-491c-8f60-5f7f1f2192b9 req-80f095fd-8d02-47c5-950b-e21e64fbb321 service nova] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-fefbd235-b20a-491c-8f60-5f7f1f2192b9 req-80f095fd-8d02-47c5-950b-e21e64fbb321 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] No waiting events found dispatching network-vif-unplugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-fefbd235-b20a-491c-8f60-5f7f1f2192b9 req-80f095fd-8d02-47c5-950b-e21e64fbb321 service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received event network-vif-unplugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:29:05 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:29:05 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=25.217849731445312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 44561486-52fb-466d-9b1f-59e7fbf79ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:29:05 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:29:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Instance destroyed successfully.
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.objects.instance [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'resources' on Instance uuid 44561486-52fb-466d-9b1f-59e7fbf79ae8 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:27:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-394840072',display_name='tempest-TestVolumeBootPattern-server-394840072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-394840072',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:27:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-z03upwis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:27:27Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=44561486-52fb-466d-9b1f-59e7fbf79ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "address": "fa:16:3e:11:17:1a", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e5bfd0-e7", "ovs_interfaceid": "f5e5bfd0-e7d9-442b-a625-a50cee51bca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:1a,bridge_name='br-int',has_traffic_filtering=True,id=f5e5bfd0-e7d9-442b-a625-a50cee51bca6,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e5bfd0-e7') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_vif [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:1a,bridge_name='br-int',has_traffic_filtering=True,id=f5e5bfd0-e7d9-442b-a625-a50cee51bca6,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e5bfd0-e7') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e5bfd0-e7, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:29:06 user nova-compute[72803]: INFO os_vif [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:17:1a,bridge_name='br-int',has_traffic_filtering=True,id=f5e5bfd0-e7d9-442b-a625-a50cee51bca6,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e5bfd0-e7')
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhWJGwvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:29:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecdfeb3-aebc-4273-b692-db2e1e0d1653]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a983ed-2dac-4e23-b00e-a92b94e81102]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:29:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:29:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c078c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b0697-c7ff-45d5-889d-967e143a9829]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6e4b9b-39b6-4ae3-b4bb-34bd1487bf0e]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5689e51a-d967-4152-9be9-376d642008e6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d62387-5ddb-4a65-9b05-1451acd7cc5c]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8a7d39-ba95-40c2-a0e0-8e7bcef7bc98]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8537aa8d-f7aa-4244-a23f-8e2400da710c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260]
Aug 15 07:29:06 user nova-compute[72803]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260] successful.
Aug 15 07:29:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[da39632b-227d-4251-b30d-0d7ba1be1998]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== disconnect_volume: return (288ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:29:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Deleting instance files /opt/stack/data/nova/instances/44561486-52fb-466d-9b1f-59e7fbf79ae8_del
Aug 15 07:29:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Deletion of /opt/stack/data/nova/instances/44561486-52fb-466d-9b1f-59e7fbf79ae8_del complete
Aug 15 07:29:06 user nova-compute[72803]: INFO nova.compute.manager [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 15 07:29:06 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:29:06 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:29:07 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:29:07 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Took 1.07 seconds to deallocate network for instance.
Aug 15 07:29:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-1334a1c7-df65-438a-b3b7-e72a9f360612 req-e63c3712-ff23-4244-bfbd-c1e64ec2c95c service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received event network-vif-deleted-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:29:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-a55fe8fd-cae2-4402-bce4-00ad0cacd8de req-290eb582-bfde-4abb-8218-8f33000f919f service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received event network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:29:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a55fe8fd-cae2-4402-bce4-00ad0cacd8de req-290eb582-bfde-4abb-8218-8f33000f919f service nova] Acquiring lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a55fe8fd-cae2-4402-bce4-00ad0cacd8de req-290eb582-bfde-4abb-8218-8f33000f919f service nova] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a55fe8fd-cae2-4402-bce4-00ad0cacd8de req-290eb582-bfde-4abb-8218-8f33000f919f service nova] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:07 user nova-compute[72803]: DEBUG nova.compute.manager [req-a55fe8fd-cae2-4402-bce4-00ad0cacd8de req-290eb582-bfde-4abb-8218-8f33000f919f service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] No waiting events found dispatching network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:29:07 user nova-compute[72803]: WARNING nova.compute.manager [req-a55fe8fd-cae2-4402-bce4-00ad0cacd8de req-290eb582-bfde-4abb-8218-8f33000f919f service nova] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Received unexpected event network-vif-plugged-f5e5bfd0-e7d9-442b-a625-a50cee51bca6 for instance with vm_state active and task_state deleting.
Aug 15 07:29:08 user nova-compute[72803]: INFO nova.compute.manager [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Took 0.79 seconds to detach 1 volumes for instance.
Aug 15 07:29:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:08 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:29:08 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:29:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:08 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Deleted allocations for instance 44561486-52fb-466d-9b1f-59e7fbf79ae8
Aug 15 07:29:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-90e9ae39-f8b6-403d-859e-192bac7b5f45 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "44561486-52fb-466d-9b1f-59e7fbf79ae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.478s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:13 user nova-compute[72803]: INFO nova.compute.manager [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Terminating instance
Aug 15 07:29:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:29:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab53f03d-d1e5-40e4-bcdf-fe6fd7c5fa41 req-b2ba8f68-9d36-4121-b404-f3522ca3379b service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-unplugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab53f03d-d1e5-40e4-bcdf-fe6fd7c5fa41 req-b2ba8f68-9d36-4121-b404-f3522ca3379b service nova] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab53f03d-d1e5-40e4-bcdf-fe6fd7c5fa41 req-b2ba8f68-9d36-4121-b404-f3522ca3379b service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ab53f03d-d1e5-40e4-bcdf-fe6fd7c5fa41 req-b2ba8f68-9d36-4121-b404-f3522ca3379b service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab53f03d-d1e5-40e4-bcdf-fe6fd7c5fa41 req-b2ba8f68-9d36-4121-b404-f3522ca3379b service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] No waiting events found dispatching network-vif-unplugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-ab53f03d-d1e5-40e4-bcdf-fe6fd7c5fa41 req-b2ba8f68-9d36-4121-b404-f3522ca3379b service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-unplugged-7286db1d-0212-4863-acff-f1206f583449 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Instance destroyed successfully.
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'resources' on Instance uuid 511e9555-52a0-4f2c-b4ff-0f68ba2c32be {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-553899271',display_name='tempest-ServerRescueNegativeTestJSON-server-553899271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-553899271',id=36,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:14:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-nyo082ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:14:54Z,user_data=None,user_id='0cf4a499a9d54262bd8959b87918717c',uuid=511e9555-52a0-4f2c-b4ff-0f68ba2c32be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "7286db1d-0212-4863-acff-f1206f583449", "address": "fa:16:3e:07:d6:0a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7286db1d-02", "ovs_interfaceid": "7286db1d-0212-4863-acff-f1206f583449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:d6:0a,bridge_name='br-int',has_traffic_filtering=True,id=7286db1d-0212-4863-acff-f1206f583449,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7286db1d-02') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG os_vif [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:d6:0a,bridge_name='br-int',has_traffic_filtering=True,id=7286db1d-0212-4863-acff-f1206f583449,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7286db1d-02') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7286db1d-02, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:29:14 user nova-compute[72803]: INFO os_vif [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:d6:0a,bridge_name='br-int',has_traffic_filtering=True,id=7286db1d-0212-4863-acff-f1206f583449,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7286db1d-02')
Aug 15 07:29:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Deleting instance files /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be_del
Aug 15 07:29:14 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Deletion of /opt/stack/data/nova/instances/511e9555-52a0-4f2c-b4ff-0f68ba2c32be_del complete
Aug 15 07:29:14 user nova-compute[72803]: INFO nova.compute.manager [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 15 07:29:14 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:29:14 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Took 0.52 seconds to deallocate network for instance.
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-60a0d9ab-fc1a-4038-bb1e-19074e46c124 req-62a90b4d-01e1-4ac9-bb02-81a6fcdf89e7 service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-deleted-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:29:14 user nova-compute[72803]: INFO nova.compute.manager [req-60a0d9ab-fc1a-4038-bb1e-19074e46c124 req-62a90b4d-01e1-4ac9-bb02-81a6fcdf89e7 service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Neutron deleted interface 7286db1d-0212-4863-acff-f1206f583449; detaching it from the instance and deleting it from the info cache
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.network.neutron [req-60a0d9ab-fc1a-4038-bb1e-19074e46c124 req-62a90b4d-01e1-4ac9-bb02-81a6fcdf89e7 service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:29:14 user nova-compute[72803]: DEBUG nova.compute.manager [req-60a0d9ab-fc1a-4038-bb1e-19074e46c124 req-62a90b4d-01e1-4ac9-bb02-81a6fcdf89e7 service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Detach interface failed, port_id=7286db1d-0212-4863-acff-f1206f583449, reason: Instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:29:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:15 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:29:15 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:29:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:15 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Deleted allocations for instance 511e9555-52a0-4f2c-b4ff-0f68ba2c32be
Aug 15 07:29:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f2b174d7-8c4b-4ed3-a723-2922c9ff2bc6 tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.517s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:16 user nova-compute[72803]: DEBUG nova.compute.manager [req-34a4db5a-42e5-461e-a0d3-75dec44f4d5c req-cb2541be-2404-4b1b-890f-31add3e89a4a service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:29:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-34a4db5a-42e5-461e-a0d3-75dec44f4d5c req-cb2541be-2404-4b1b-890f-31add3e89a4a service nova] Acquiring lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-34a4db5a-42e5-461e-a0d3-75dec44f4d5c req-cb2541be-2404-4b1b-890f-31add3e89a4a service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-34a4db5a-42e5-461e-a0d3-75dec44f4d5c req-cb2541be-2404-4b1b-890f-31add3e89a4a service nova] Lock "511e9555-52a0-4f2c-b4ff-0f68ba2c32be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:16 user nova-compute[72803]: DEBUG nova.compute.manager [req-34a4db5a-42e5-461e-a0d3-75dec44f4d5c req-cb2541be-2404-4b1b-890f-31add3e89a4a service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] No waiting events found dispatching network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:29:16 user nova-compute[72803]: WARNING nova.compute.manager [req-34a4db5a-42e5-461e-a0d3-75dec44f4d5c req-cb2541be-2404-4b1b-890f-31add3e89a4a service nova] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Received unexpected event network-vif-plugged-7286db1d-0212-4863-acff-f1206f583449 for instance with vm_state deleted and task_state None.
Aug 15 07:29:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:21 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084546.0876465, 44561486-52fb-466d-9b1f-59e7fbf79ae8 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:29:21 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] VM Stopped (Lifecycle Event)
Aug 15 07:29:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f4f7deea-4a13-436f-83b3-8581c51f13d0 None None] [instance: 44561486-52fb-466d-9b1f-59e7fbf79ae8] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:29:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:29 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084554.3433156, 511e9555-52a0-4f2c-b4ff-0f68ba2c32be => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:29:29 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] VM Stopped (Lifecycle Event)
Aug 15 07:29:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-13bf76a0-d269-4882-a134-fc2035367d31 None None] [instance: 511e9555-52a0-4f2c-b4ff-0f68ba2c32be] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:29:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:29:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:29:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:29:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:29:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:29:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:29:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:29:55 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:55 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "a9abe053-d27e-468e-9828-d7a16a2aef21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:29:57 user nova-compute[72803]: INFO nova.compute.claims [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Claim successful on node user
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:29:57 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:29:57 user nova-compute[72803]: INFO nova.virt.block_device [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Booting with volume 7850018b-961e-4b7e-bc3c-92f2a09e1f90 at /dev/vda
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.policy [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '962292c4846b4ceab2cb00867135e136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9714fffd91c94d79aaa288d93fdfaffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG os_brick.utils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ab00f2-7768-4d38-badc-839a51a8993b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8ec55a-a905-4ea9-9f5f-b912884cfcf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff0b97-e581-4442-ab82-f28325a5d889]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50363b2-0ed0-4596-aba2-66eb3da5e27c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:29:57 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:29:57 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f5e7f9-5d42-40b5-96c0-69fa38278538]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG os_brick.utils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:29:57 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating existing volume attachment record: f5614deb-bb79-40dd-986f-0482be984a1e {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:29:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Successfully created port: df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:29:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Successfully updated port: df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:29:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:29:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquired lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:29:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-e95ad6f9-8d3b-4650-a7ae-3c24186a3bff req-1d05af4a-757c-46b3-b94e-ffbb318b532c service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-changed-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-e95ad6f9-8d3b-4650-a7ae-3c24186a3bff req-1d05af4a-757c-46b3-b94e-ffbb318b532c service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Refreshing instance network info cache due to event network-changed-df7354a5-4cc5-41e1-8667-d01a943b7032. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e95ad6f9-8d3b-4650-a7ae-3c24186a3bff req-1d05af4a-757c-46b3-b94e-ffbb318b532c service nova] Acquiring lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating instance_info_cache with network_info: [{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Releasing lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Instance network_info: |[{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e95ad6f9-8d3b-4650-a7ae-3c24186a3bff req-1d05af4a-757c-46b3-b94e-ffbb318b532c service nova] Acquired lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-e95ad6f9-8d3b-4650-a7ae-3c24186a3bff req-1d05af4a-757c-46b3-b94e-ffbb318b532c service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Refreshing network info cache for port df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-e95ad6f9-8d3b-4650-a7ae-3c24186a3bff req-1d05af4a-757c-46b3-b94e-ffbb318b532c service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updated VIF entry in instance network info cache for port df7354a5-4cc5-41e1-8667-d01a943b7032. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-e95ad6f9-8d3b-4650-a7ae-3c24186a3bff req-1d05af4a-757c-46b3-b94e-ffbb318b532c service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating instance_info_cache with network_info: [{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:29:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-e95ad6f9-8d3b-4650-a7ae-3c24186a3bff req-1d05af4a-757c-46b3-b94e-ffbb318b532c service nova] Releasing lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:30:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "39617700-3648-4f38-b129-0c71584828c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:04 user nova-compute[72803]: INFO nova.compute.manager [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Terminating instance
Aug 15 07:30:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-2149a9c1-de65-461e-aca1-480e67c4426b req-0eeb930b-751e-4960-bdc2-80c2cf600dfa service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2149a9c1-de65-461e-aca1-480e67c4426b req-0eeb930b-751e-4960-bdc2-80c2cf600dfa service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2149a9c1-de65-461e-aca1-480e67c4426b req-0eeb930b-751e-4960-bdc2-80c2cf600dfa service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2149a9c1-de65-461e-aca1-480e67c4426b req-0eeb930b-751e-4960-bdc2-80c2cf600dfa service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-2149a9c1-de65-461e-aca1-480e67c4426b req-0eeb930b-751e-4960-bdc2-80c2cf600dfa service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-2149a9c1-de65-461e-aca1-480e67c4426b req-0eeb930b-751e-4960-bdc2-80c2cf600dfa service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-unplugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:05 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] Instance destroyed successfully.
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.objects.instance [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lazy-loading 'resources' on Instance uuid 39617700-3648-4f38-b129-0c71584828c9 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:12:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-622417303',display_name='tempest-ServerRescueNegativeTestJSON-server-622417303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-622417303',id=35,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaa8ac0862d14e7792d6c03f46c170ba',ramdisk_id='',reservation_id='r-rhfwcjxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1974019782',owner_user_name='tempest-ServerRescueNegativeTestJSON-1974019782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:19:39Z,user_data=None,user_id='0cf4a499a9d54262bd8959b87918717c',uuid=39617700-3648-4f38-b129-0c71584828c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converting VIF {"id": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "address": "fa:16:3e:56:c4:5a", "network": {"id": "0b929e47-8860-44ec-bb42-6f27946d214a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-374491735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaa8ac0862d14e7792d6c03f46c170ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e86640-e2", "ovs_interfaceid": "98e86640-e22c-4601-a1d7-6ed0ddf79cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e86640-e2') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG os_vif [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e86640-e2') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98e86640-e2, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:30:05 user nova-compute[72803]: INFO os_vif [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:c4:5a,bridge_name='br-int',has_traffic_filtering=True,id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2,network=Network(0b929e47-8860-44ec-bb42-6f27946d214a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e86640-e2')
Aug 15 07:30:05 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Deleting instance files /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9_del
Aug 15 07:30:05 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Deletion of /opt/stack/data/nova/instances/39617700-3648-4f38-b129-0c71584828c9_del complete
Aug 15 07:30:05 user nova-compute[72803]: INFO nova.compute.manager [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] [instance: 39617700-3648-4f38-b129-0c71584828c9] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 07:30:05 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.compute.manager [req-ba8b07da-7428-4219-8851-df94883592cb req-80f070f0-8f0f-4c08-9a87-825e80e884b7 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-deleted-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:30:05 user nova-compute[72803]: INFO nova.compute.manager [req-ba8b07da-7428-4219-8851-df94883592cb req-80f070f0-8f0f-4c08-9a87-825e80e884b7 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Neutron deleted interface 98e86640-e22c-4601-a1d7-6ed0ddf79cd2; detaching it from the instance and deleting it from the info cache
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.network.neutron [req-ba8b07da-7428-4219-8851-df94883592cb req-80f070f0-8f0f-4c08-9a87-825e80e884b7 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:30:05 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:30:05 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.312259674072266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:05 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-ba8b07da-7428-4219-8851-df94883592cb req-80f070f0-8f0f-4c08-9a87-825e80e884b7 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Detach interface failed, port_id=98e86640-e22c-4601-a1d7-6ed0ddf79cd2, reason: Instance 39617700-3648-4f38-b129-0c71584828c9 could not be found. {{(pid=72803) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 07:30:06 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] Took 0.84 seconds to deallocate network for instance.
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 39617700-3648-4f38-b129-0c71584828c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a9abe053-d27e-468e-9828-d7a16a2aef21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:30:06 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Creating image(s)
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Ensure instance console log exists: /opt/stack/data/nova/instances/a9abe053-d27e-468e-9828-d7a16a2aef21/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Start _get_guest_xml network_info=[{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': 'f5614deb-bb79-40dd-986f-0482be984a1e', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhWJGwvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9abe053-d27e-468e-9828-d7a16a2aef21', 'attached_at': '', 'detached_at': '', 'volume_id': '7850018b-961e-4b7e-bc3c-92f2a09e1f90', 'serial': '7850018b-961e-4b7e-bc3c-92f2a09e1f90'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:30:06 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:30:06 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.139s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhWJGwvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:30:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:30:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:30:06 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[48da647c-a425-4cea-b1bc-8199e4318252]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:30:06 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0190a5c9-83e9-4734-93f1-84c79b364302]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90] added
Aug 15 07:30:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8153b21-cc04-463b-a673-a36c9da881df]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fb7aef-fd52-48d3-9baf-12fda79e4f68]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mhWJGwvx {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mhWJGwvx" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2cdf3-19b4-485b-a145-b0fd7be392ae]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mhWJGwvx'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96349e5-3d69-45b6-93f4-760af7e6b614]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Deleted allocations for instance 39617700-3648-4f38-b129-0c71584828c9
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[be55d7ef-0646-4791-ae02-9f589a770660]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:30:06 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:30:06 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:30:06 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 07:30:06 user nova-compute[72803]: 
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ec8365-1f82-4880-a20d-3f3feadd3285]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260]
Aug 15 07:30:06 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260] successful.
Aug 15 07:30:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4daf3abd-8b2e-476c-886a-5f74f37cd5bd tempest-ServerRescueNegativeTestJSON-1974019782 tempest-ServerRescueNegativeTestJSON-1974019782-project-member] Lock "39617700-3648-4f38-b129-0c71584828c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca12b5f8-4ccd-448a-948a-3e84384d5f34]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[881babf0-97a3-43bf-8bd0-74a6cc468796]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:30:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:30:06 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae6c8f-e854-47d5-8541-3d680169628f]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhWJGwvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-bf347389-9836-44a7-809d-800d964ee880 req-98a4338b-76e7-40e9-91d5-be2c44e9d277 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bf347389-9836-44a7-809d-800d964ee880 req-98a4338b-76e7-40e9-91d5-be2c44e9d277 service nova] Acquiring lock "39617700-3648-4f38-b129-0c71584828c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bf347389-9836-44a7-809d-800d964ee880 req-98a4338b-76e7-40e9-91d5-be2c44e9d277 service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-bf347389-9836-44a7-809d-800d964ee880 req-98a4338b-76e7-40e9-91d5-be2c44e9d277 service nova] Lock "39617700-3648-4f38-b129-0c71584828c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:06 user nova-compute[72803]: DEBUG nova.compute.manager [req-bf347389-9836-44a7-809d-800d964ee880 req-98a4338b-76e7-40e9-91d5-be2c44e9d277 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] No waiting events found dispatching network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:30:06 user nova-compute[72803]: WARNING nova.compute.manager [req-bf347389-9836-44a7-809d-800d964ee880 req-98a4338b-76e7-40e9-91d5-be2c44e9d277 service nova] [instance: 39617700-3648-4f38-b129-0c71584828c9] Received unexpected event network-vif-plugged-98e86640-e22c-4601-a1d7-6ed0ddf79cd2 for instance with vm_state deleted and task_state None.
Aug 15 07:30:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23939343532663066', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939343532663066', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-103247724',display_name='tempest-TestVolumeBootPattern-server-103247724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-103247724',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-a87re049',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:29:58Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=a9abe053-d27e-468e-9828-d7a16a2aef21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:50:84,bridge_name='br-int',has_traffic_filtering=True,id=df7354a5-4cc5-41e1-8667-d01a943b7032,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7354a5-4c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'pci_devices' on Instance uuid a9abe053-d27e-468e-9828-d7a16a2aef21 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:30:07 user nova-compute[72803]:   <uuid>a9abe053-d27e-468e-9828-d7a16a2aef21</uuid>
Aug 15 07:30:07 user nova-compute[72803]:   <name>instance-00000030</name>
Aug 15 07:30:07 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:30:07 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:30:07 user nova-compute[72803]:   <metadata>
Aug 15 07:30:07 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:30:07 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:30:07 user nova-compute[72803]:       <nova:name>tempest-TestVolumeBootPattern-server-103247724</nova:name>
Aug 15 07:30:07 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:30:06</nova:creationTime>
Aug 15 07:30:07 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:30:07 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:30:07 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:30:07 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:30:07 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:30:07 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:30:07 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:30:07 user nova-compute[72803]:       <nova:owner>
Aug 15 07:30:07 user nova-compute[72803]:         <nova:user uuid="962292c4846b4ceab2cb00867135e136">tempest-TestVolumeBootPattern-940544162-project-member</nova:user>
Aug 15 07:30:07 user nova-compute[72803]:         <nova:project uuid="9714fffd91c94d79aaa288d93fdfaffa">tempest-TestVolumeBootPattern-940544162</nova:project>
Aug 15 07:30:07 user nova-compute[72803]:       </nova:owner>
Aug 15 07:30:07 user nova-compute[72803]:       <nova:ports>
Aug 15 07:30:07 user nova-compute[72803]:         <nova:port uuid="df7354a5-4cc5-41e1-8667-d01a943b7032">
Aug 15 07:30:07 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 07:30:07 user nova-compute[72803]:         </nova:port>
Aug 15 07:30:07 user nova-compute[72803]:       </nova:ports>
Aug 15 07:30:07 user nova-compute[72803]:     </nova:instance>
Aug 15 07:30:07 user nova-compute[72803]:   </metadata>
Aug 15 07:30:07 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:30:07 user nova-compute[72803]:     <system>
Aug 15 07:30:07 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:30:07 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:30:07 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:30:07 user nova-compute[72803]:       <entry name="serial">a9abe053-d27e-468e-9828-d7a16a2aef21</entry>
Aug 15 07:30:07 user nova-compute[72803]:       <entry name="uuid">a9abe053-d27e-468e-9828-d7a16a2aef21</entry>
Aug 15 07:30:07 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:30:07 user nova-compute[72803]:     </system>
Aug 15 07:30:07 user nova-compute[72803]:   </sysinfo>
Aug 15 07:30:07 user nova-compute[72803]:   <os>
Aug 15 07:30:07 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:30:07 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:30:07 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:30:07 user nova-compute[72803]:   </os>
Aug 15 07:30:07 user nova-compute[72803]:   <features>
Aug 15 07:30:07 user nova-compute[72803]:     <acpi/>
Aug 15 07:30:07 user nova-compute[72803]:     <apic/>
Aug 15 07:30:07 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:30:07 user nova-compute[72803]:   </features>
Aug 15 07:30:07 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:30:07 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:30:07 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:30:07 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:30:07 user nova-compute[72803]:   </clock>
Aug 15 07:30:07 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:30:07 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:30:07 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:30:07 user nova-compute[72803]:   </cpu>
Aug 15 07:30:07 user nova-compute[72803]:   <devices>
Aug 15 07:30:07 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:30:07 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:30:07 user nova-compute[72803]:       <source dev="/dev/sdb"/>
Aug 15 07:30:07 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:30:07 user nova-compute[72803]:       <serial>7850018b-961e-4b7e-bc3c-92f2a09e1f90</serial>
Aug 15 07:30:07 user nova-compute[72803]:     </disk>
Aug 15 07:30:07 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:30:07 user nova-compute[72803]:       <mac address="fa:16:3e:ea:50:84"/>
Aug 15 07:30:07 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:30:07 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:30:07 user nova-compute[72803]:       <target dev="tapdf7354a5-4c"/>
Aug 15 07:30:07 user nova-compute[72803]:     </interface>
Aug 15 07:30:07 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:30:07 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/a9abe053-d27e-468e-9828-d7a16a2aef21/console.log" append="off"/>
Aug 15 07:30:07 user nova-compute[72803]:     </serial>
Aug 15 07:30:07 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:30:07 user nova-compute[72803]:     <video>
Aug 15 07:30:07 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:30:07 user nova-compute[72803]:     </video>
Aug 15 07:30:07 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:30:07 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:30:07 user nova-compute[72803]:     </rng>
Aug 15 07:30:07 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:30:07 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:30:07 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:30:07 user nova-compute[72803]:     </memballoon>
Aug 15 07:30:07 user nova-compute[72803]:   </devices>
Aug 15 07:30:07 user nova-compute[72803]: </domain>
Aug 15 07:30:07 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-103247724',display_name='tempest-TestVolumeBootPattern-server-103247724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-103247724',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-a87re049',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:29:58Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=a9abe053-d27e-468e-9828-d7a16a2aef21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:50:84,bridge_name='br-int',has_traffic_filtering=True,id=df7354a5-4cc5-41e1-8667-d01a943b7032,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7354a5-4c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG os_vif [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:50:84,bridge_name='br-int',has_traffic_filtering=True,id=df7354a5-4cc5-41e1-8667-d01a943b7032,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7354a5-4c') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf7354a5-4c, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf7354a5-4c, col_values=(('external_ids', {'iface-id': 'df7354a5-4cc5-41e1-8667-d01a943b7032', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:50:84', 'vm-uuid': 'a9abe053-d27e-468e-9828-d7a16a2aef21'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:07 user nova-compute[72803]: INFO os_vif [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:50:84,bridge_name='br-int',has_traffic_filtering=True,id=df7354a5-4cc5-41e1-8667-d01a943b7032,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7354a5-4c')
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:30:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No VIF found with MAC fa:16:3e:ea:50:84, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:30:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-529d102f-d014-4acb-a0c7-bf10506d0863 req-c2997378-0156-40a5-8f04-11021e83b861 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:30:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-529d102f-d014-4acb-a0c7-bf10506d0863 req-c2997378-0156-40a5-8f04-11021e83b861 service nova] Acquiring lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-529d102f-d014-4acb-a0c7-bf10506d0863 req-c2997378-0156-40a5-8f04-11021e83b861 service nova] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-529d102f-d014-4acb-a0c7-bf10506d0863 req-c2997378-0156-40a5-8f04-11021e83b861 service nova] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-529d102f-d014-4acb-a0c7-bf10506d0863 req-c2997378-0156-40a5-8f04-11021e83b861 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] No waiting events found dispatching network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:30:09 user nova-compute[72803]: WARNING nova.compute.manager [req-529d102f-d014-4acb-a0c7-bf10506d0863 req-c2997378-0156-40a5-8f04-11021e83b861 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received unexpected event network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 for instance with vm_state building and task_state spawning.
Aug 15 07:30:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084611.1098444, a9abe053-d27e-468e-9828-d7a16a2aef21 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:30:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] VM Resumed (Lifecycle Event)
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:30:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Instance spawned successfully.
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:30:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084611.1116192, a9abe053-d27e-468e-9828-d7a16a2aef21 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:30:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] VM Started (Lifecycle Event)
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:30:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:30:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:30:11 user nova-compute[72803]: INFO nova.compute.manager [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Took 14.12 seconds to build instance.
Aug 15 07:30:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3824c7db-4e52-4e18-a310-1b73c36aab7b tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.207s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-afbc692f-6a1c-4eac-9a68-0eb5a73d0de8 req-f336e73c-a7cd-44e1-8699-2114b8f7c8c6 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-afbc692f-6a1c-4eac-9a68-0eb5a73d0de8 req-f336e73c-a7cd-44e1-8699-2114b8f7c8c6 service nova] Acquiring lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-afbc692f-6a1c-4eac-9a68-0eb5a73d0de8 req-f336e73c-a7cd-44e1-8699-2114b8f7c8c6 service nova] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-afbc692f-6a1c-4eac-9a68-0eb5a73d0de8 req-f336e73c-a7cd-44e1-8699-2114b8f7c8c6 service nova] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:30:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-afbc692f-6a1c-4eac-9a68-0eb5a73d0de8 req-f336e73c-a7cd-44e1-8699-2114b8f7c8c6 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] No waiting events found dispatching network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:30:11 user nova-compute[72803]: WARNING nova.compute.manager [req-afbc692f-6a1c-4eac-9a68-0eb5a73d0de8 req-f336e73c-a7cd-44e1-8699-2114b8f7c8c6 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received unexpected event network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 for instance with vm_state active and task_state None.
Aug 15 07:30:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:20 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084605.0524387, 39617700-3648-4f38-b129-0c71584828c9 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:30:20 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 39617700-3648-4f38-b129-0c71584828c9] VM Stopped (Lifecycle Event)
Aug 15 07:30:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-af062c96-6e67-4bd8-a502-d26903d1e390 None None] [instance: 39617700-3648-4f38-b129-0c71584828c9] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:30:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:30:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:30:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:30:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:30:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:30:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:54 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:30:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:30:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:31:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:31:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:31:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:31:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:03 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:31:05 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid a9abe053-d27e-468e-9828-d7a16a2aef21 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating instance_info_cache with network_info: [{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:31:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "98b88fe2-798c-4160-b698-1680d220da81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "98b88fe2-798c-4160-b698-1680d220da81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:07 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:31:07 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.310104370117188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a9abe053-d27e-468e-9828-d7a16a2aef21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.199s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:31:07 user nova-compute[72803]: INFO nova.compute.claims [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Claim successful on node user
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:31:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:31:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Creating image(s)
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "/opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "/opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "/opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:31:07 user nova-compute[72803]: DEBUG nova.policy [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ded0c369e6364afbafd178ddc2d0ec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354415c38b24e8ea507ff68916ffa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.239s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk 1073741824" returned: 0 in 0.052s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.207s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Successfully created port: 1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Cannot resize image /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lazy-loading 'migration_context' on Instance uuid 98b88fe2-798c-4160-b698-1680d220da81 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Ensure instance console log exists: /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Successfully updated port: 1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquired lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f682bab-acff-4cc6-b7de-6ec6835bb214 req-e61f5c92-e550-4185-b23f-e2830596f25c service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received event network-changed-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-3f682bab-acff-4cc6-b7de-6ec6835bb214 req-e61f5c92-e550-4185-b23f-e2830596f25c service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Refreshing instance network info cache due to event network-changed-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f682bab-acff-4cc6-b7de-6ec6835bb214 req-e61f5c92-e550-4185-b23f-e2830596f25c service nova] Acquiring lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updating instance_info_cache with network_info: [{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Releasing lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Instance network_info: |[{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f682bab-acff-4cc6-b7de-6ec6835bb214 req-e61f5c92-e550-4185-b23f-e2830596f25c service nova] Acquired lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f682bab-acff-4cc6-b7de-6ec6835bb214 req-e61f5c92-e550-4185-b23f-e2830596f25c service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Refreshing network info cache for port 1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Start _get_guest_xml network_info=[{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:31:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:31:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-531139667',display_name='tempest-ServersNegativeTestJSON-server-531139667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-531139667',id=49,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5354415c38b24e8ea507ff68916ffa43',ramdisk_id='',reservation_id='r-n8ko7vsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-387859981',owner_user_name='tempest-ServersNegativeTestJSON-387859981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:31:08Z,user_data=None,user_id='ded0c369e6364afbafd178ddc2d0ec74',uuid=98b88fe2-798c-4160-b698-1680d220da81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converting VIF {"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=1d6f6feb-299a-4e25-bb3b-c74d0ca983b2,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6f6feb-29') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lazy-loading 'pci_devices' on Instance uuid 98b88fe2-798c-4160-b698-1680d220da81 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:31:09 user nova-compute[72803]:   <uuid>98b88fe2-798c-4160-b698-1680d220da81</uuid>
Aug 15 07:31:09 user nova-compute[72803]:   <name>instance-00000031</name>
Aug 15 07:31:09 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:31:09 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:31:09 user nova-compute[72803]:   <metadata>
Aug 15 07:31:09 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:31:09 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:31:09 user nova-compute[72803]:       <nova:name>tempest-ServersNegativeTestJSON-server-531139667</nova:name>
Aug 15 07:31:09 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:31:09</nova:creationTime>
Aug 15 07:31:09 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:31:09 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:31:09 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:31:09 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:31:09 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:31:09 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:31:09 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:31:09 user nova-compute[72803]:       <nova:owner>
Aug 15 07:31:09 user nova-compute[72803]:         <nova:user uuid="ded0c369e6364afbafd178ddc2d0ec74">tempest-ServersNegativeTestJSON-387859981-project-member</nova:user>
Aug 15 07:31:09 user nova-compute[72803]:         <nova:project uuid="5354415c38b24e8ea507ff68916ffa43">tempest-ServersNegativeTestJSON-387859981</nova:project>
Aug 15 07:31:09 user nova-compute[72803]:       </nova:owner>
Aug 15 07:31:09 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:31:09 user nova-compute[72803]:       <nova:ports>
Aug 15 07:31:09 user nova-compute[72803]:         <nova:port uuid="1d6f6feb-299a-4e25-bb3b-c74d0ca983b2">
Aug 15 07:31:09 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 07:31:09 user nova-compute[72803]:         </nova:port>
Aug 15 07:31:09 user nova-compute[72803]:       </nova:ports>
Aug 15 07:31:09 user nova-compute[72803]:     </nova:instance>
Aug 15 07:31:09 user nova-compute[72803]:   </metadata>
Aug 15 07:31:09 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:31:09 user nova-compute[72803]:     <system>
Aug 15 07:31:09 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:31:09 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:31:09 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:31:09 user nova-compute[72803]:       <entry name="serial">98b88fe2-798c-4160-b698-1680d220da81</entry>
Aug 15 07:31:09 user nova-compute[72803]:       <entry name="uuid">98b88fe2-798c-4160-b698-1680d220da81</entry>
Aug 15 07:31:09 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:31:09 user nova-compute[72803]:     </system>
Aug 15 07:31:09 user nova-compute[72803]:   </sysinfo>
Aug 15 07:31:09 user nova-compute[72803]:   <os>
Aug 15 07:31:09 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:31:09 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:31:09 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:31:09 user nova-compute[72803]:   </os>
Aug 15 07:31:09 user nova-compute[72803]:   <features>
Aug 15 07:31:09 user nova-compute[72803]:     <acpi/>
Aug 15 07:31:09 user nova-compute[72803]:     <apic/>
Aug 15 07:31:09 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:31:09 user nova-compute[72803]:   </features>
Aug 15 07:31:09 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:31:09 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:31:09 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:31:09 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:31:09 user nova-compute[72803]:   </clock>
Aug 15 07:31:09 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:31:09 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:31:09 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:31:09 user nova-compute[72803]:   </cpu>
Aug 15 07:31:09 user nova-compute[72803]:   <devices>
Aug 15 07:31:09 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:31:09 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:31:09 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk"/>
Aug 15 07:31:09 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:31:09 user nova-compute[72803]:     </disk>
Aug 15 07:31:09 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:31:09 user nova-compute[72803]:       <mac address="fa:16:3e:0f:9f:bf"/>
Aug 15 07:31:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:31:09 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:31:09 user nova-compute[72803]:       <target dev="tap1d6f6feb-29"/>
Aug 15 07:31:09 user nova-compute[72803]:     </interface>
Aug 15 07:31:09 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:31:09 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/console.log" append="off"/>
Aug 15 07:31:09 user nova-compute[72803]:     </serial>
Aug 15 07:31:09 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:31:09 user nova-compute[72803]:     <video>
Aug 15 07:31:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:31:09 user nova-compute[72803]:     </video>
Aug 15 07:31:09 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:31:09 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:31:09 user nova-compute[72803]:     </rng>
Aug 15 07:31:09 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:31:09 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:31:09 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:31:09 user nova-compute[72803]:     </memballoon>
Aug 15 07:31:09 user nova-compute[72803]:   </devices>
Aug 15 07:31:09 user nova-compute[72803]: </domain>
Aug 15 07:31:09 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-531139667',display_name='tempest-ServersNegativeTestJSON-server-531139667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-531139667',id=49,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5354415c38b24e8ea507ff68916ffa43',ramdisk_id='',reservation_id='r-n8ko7vsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-387859981',owner_user_name='tempest-ServersNegativeTestJSON-387859981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:31:08Z,user_data=None,user_id='ded0c369e6364afbafd178ddc2d0ec74',uuid=98b88fe2-798c-4160-b698-1680d220da81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converting VIF {"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=1d6f6feb-299a-4e25-bb3b-c74d0ca983b2,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6f6feb-29') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG os_vif [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=1d6f6feb-299a-4e25-bb3b-c74d0ca983b2,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6f6feb-29') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d6f6feb-29, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d6f6feb-29, col_values=(('external_ids', {'iface-id': '1d6f6feb-299a-4e25-bb3b-c74d0ca983b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:9f:bf', 'vm-uuid': '98b88fe2-798c-4160-b698-1680d220da81'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:31:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:09 user nova-compute[72803]: INFO os_vif [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=1d6f6feb-299a-4e25-bb3b-c74d0ca983b2,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6f6feb-29')
Aug 15 07:31:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:31:10 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] No VIF found with MAC fa:16:3e:0f:9f:bf, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:31:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f682bab-acff-4cc6-b7de-6ec6835bb214 req-e61f5c92-e550-4185-b23f-e2830596f25c service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updated VIF entry in instance network info cache for port 1d6f6feb-299a-4e25-bb3b-c74d0ca983b2. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:31:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-3f682bab-acff-4cc6-b7de-6ec6835bb214 req-e61f5c92-e550-4185-b23f-e2830596f25c service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updating instance_info_cache with network_info: [{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:31:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3f682bab-acff-4cc6-b7de-6ec6835bb214 req-e61f5c92-e550-4185-b23f-e2830596f25c service nova] Releasing lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-52c56b2f-1500-426a-836e-b6b89a1addf0 req-07badcfe-19ce-4760-8e7d-f52e0e206583 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received event network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-52c56b2f-1500-426a-836e-b6b89a1addf0 req-07badcfe-19ce-4760-8e7d-f52e0e206583 service nova] Acquiring lock "98b88fe2-798c-4160-b698-1680d220da81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-52c56b2f-1500-426a-836e-b6b89a1addf0 req-07badcfe-19ce-4760-8e7d-f52e0e206583 service nova] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-52c56b2f-1500-426a-836e-b6b89a1addf0 req-07badcfe-19ce-4760-8e7d-f52e0e206583 service nova] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-52c56b2f-1500-426a-836e-b6b89a1addf0 req-07badcfe-19ce-4760-8e7d-f52e0e206583 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] No waiting events found dispatching network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:31:11 user nova-compute[72803]: WARNING nova.compute.manager [req-52c56b2f-1500-426a-836e-b6b89a1addf0 req-07badcfe-19ce-4760-8e7d-f52e0e206583 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received unexpected event network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 for instance with vm_state building and task_state spawning.
Aug 15 07:31:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084673.3868861, 98b88fe2-798c-4160-b698-1680d220da81 => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:31:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] VM Resumed (Lifecycle Event)
Aug 15 07:31:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Instance spawned successfully.
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:31:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084673.3883185, 98b88fe2-798c-4160-b698-1680d220da81 => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:31:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] VM Started (Lifecycle Event)
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:31:13 user nova-compute[72803]: INFO nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:31:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:31:13 user nova-compute[72803]: INFO nova.compute.manager [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Took 6.39 seconds to build instance.
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-ce161898-7dde-4a4e-b63e-734acaeff2c5 req-46559edd-c0fc-4712-825a-1a06590c2df6 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received event network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ce161898-7dde-4a4e-b63e-734acaeff2c5 req-46559edd-c0fc-4712-825a-1a06590c2df6 service nova] Acquiring lock "98b88fe2-798c-4160-b698-1680d220da81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ce161898-7dde-4a4e-b63e-734acaeff2c5 req-46559edd-c0fc-4712-825a-1a06590c2df6 service nova] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ce161898-7dde-4a4e-b63e-734acaeff2c5 req-46559edd-c0fc-4712-825a-1a06590c2df6 service nova] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-ce161898-7dde-4a4e-b63e-734acaeff2c5 req-46559edd-c0fc-4712-825a-1a06590c2df6 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] No waiting events found dispatching network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:31:13 user nova-compute[72803]: WARNING nova.compute.manager [req-ce161898-7dde-4a4e-b63e-734acaeff2c5 req-46559edd-c0fc-4712-825a-1a06590c2df6 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received unexpected event network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 for instance with vm_state active and task_state None.
Aug 15 07:31:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e81a5b5b-799f-4425-ad6d-c4311ddc6d75 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "98b88fe2-798c-4160-b698-1680d220da81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.522s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Verify base images {{(pid=72803) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Image id 058dab3c-04e2-4357-a904-efeb3f5412a5 yields fingerprint f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 {{(pid=72803) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] image 058dab3c-04e2-4357-a904-efeb3f5412a5 at (/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718): checking
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] image 058dab3c-04e2-4357-a904-efeb3f5412a5 at (/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718): image is in use {{(pid=72803) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72803) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] a9abe053-d27e-468e-9828-d7a16a2aef21 is a valid instance name {{(pid=72803) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] 98b88fe2-798c-4160-b698-1680d220da81 is a valid instance name {{(pid=72803) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] 98b88fe2-798c-4160-b698-1680d220da81 has a disk file {{(pid=72803) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 is backed by f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 {{(pid=72803) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f
Aug 15 07:31:19 user nova-compute[72803]: WARNING nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Unknown base file: /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Active base files: /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Removable base files: /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2 /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1 /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034 /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236 /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9 /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a366d16291cdedee99a57aa947baa20682c9ddc2
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e044bd732842926a22611a54fff3bea7bf401cc1
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/384d16b3832c10f45ffdd491e81d48eac7caf034
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f09012df04ebecdce684b91104887f7c0b9318be
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a86852d91f021a5bcb36ac3dde3ba3e23c6ca58e
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb8d7654954d9a3578bd177a039a2d8c2c5ef236
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/846c024ace159ddb702617ae5c0c14df8d0660d9
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f7956ec0fe7cefd3fb088dbd88c37a985b13876f
Aug 15 07:31:19 user nova-compute[72803]: INFO nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0ec0921144432c1f1f043eac7424e8d5d0072325
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Verification complete {{(pid=72803) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Verify swap images {{(pid=72803) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG nova.virt.libvirt.imagecache [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Verify ephemeral images {{(pid=72803) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 07:31:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:31:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-9d94e4d3-cb95-44a9-b93c-e47d31a516a9 req-eac3bbdf-5fdb-49d4-a89f-9610096a38b4 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-changed-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:31:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-9d94e4d3-cb95-44a9-b93c-e47d31a516a9 req-eac3bbdf-5fdb-49d4-a89f-9610096a38b4 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Refreshing instance network info cache due to event network-changed-df7354a5-4cc5-41e1-8667-d01a943b7032. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:31:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d94e4d3-cb95-44a9-b93c-e47d31a516a9 req-eac3bbdf-5fdb-49d4-a89f-9610096a38b4 service nova] Acquiring lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:31:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d94e4d3-cb95-44a9-b93c-e47d31a516a9 req-eac3bbdf-5fdb-49d4-a89f-9610096a38b4 service nova] Acquired lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:31:48 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d94e4d3-cb95-44a9-b93c-e47d31a516a9 req-eac3bbdf-5fdb-49d4-a89f-9610096a38b4 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Refreshing network info cache for port df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:31:49 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d94e4d3-cb95-44a9-b93c-e47d31a516a9 req-eac3bbdf-5fdb-49d4-a89f-9610096a38b4 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updated VIF entry in instance network info cache for port df7354a5-4cc5-41e1-8667-d01a943b7032. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:31:49 user nova-compute[72803]: DEBUG nova.network.neutron [req-9d94e4d3-cb95-44a9-b93c-e47d31a516a9 req-eac3bbdf-5fdb-49d4-a89f-9610096a38b4 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating instance_info_cache with network_info: [{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:31:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-9d94e4d3-cb95-44a9-b93c-e47d31a516a9 req-eac3bbdf-5fdb-49d4-a89f-9610096a38b4 service nova] Releasing lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:31:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:53 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:31:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:31:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:01 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:32:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:01 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:32:01 user nova-compute[72803]: INFO nova.compute.claims [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Claim successful on node user
Aug 15 07:32:01 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:32:01 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:32:02 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:32:02 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:32:02 user nova-compute[72803]: INFO nova.virt.block_device [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Booting with volume 019100af-66f4-4966-994a-72d1a8d16f8c at /dev/vda
Aug 15 07:32:02 user nova-compute[72803]: DEBUG nova.policy [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '962292c4846b4ceab2cb00867135e136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9714fffd91c94d79aaa288d93fdfaffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG os_brick.utils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc6d1d-cbd9-4dbb-bef3-dbafb093f7a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a288cf1a-755c-4151-a7ca-0a0571036c5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e45f2c-4b53-49e9-9c0c-8bb74473a396]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1957d82-cffe-4bc0-9e59-66de083805e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:32:02 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dfeacd-8f01-4623-9b59-9962a568fe62]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG os_brick.utils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updating existing volume attachment record: 16471bca-0820-48cc-8acf-37d56a0416f8 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:02 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Successfully created port: 3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Successfully updated port: 3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquired lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-73536e3a-5228-4cf3-be09-80d6c83eb74e req-2dbecf03-e9e0-419d-84e3-f021ae8d2d53 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-changed-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG nova.compute.manager [req-73536e3a-5228-4cf3-be09-80d6c83eb74e req-2dbecf03-e9e0-419d-84e3-f021ae8d2d53 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Refreshing instance network info cache due to event network-changed-3fb794e4-d38b-4847-a456-fdbf86f54590. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-73536e3a-5228-4cf3-be09-80d6c83eb74e req-2dbecf03-e9e0-419d-84e3-f021ae8d2d53 service nova] Acquiring lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG nova.network.neutron [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updating instance_info_cache with network_info: [{"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Releasing lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Instance network_info: |[{"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-73536e3a-5228-4cf3-be09-80d6c83eb74e req-2dbecf03-e9e0-419d-84e3-f021ae8d2d53 service nova] Acquired lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:32:03 user nova-compute[72803]: DEBUG nova.network.neutron [req-73536e3a-5228-4cf3-be09-80d6c83eb74e req-2dbecf03-e9e0-419d-84e3-f021ae8d2d53 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Refreshing network info cache for port 3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:32:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-73536e3a-5228-4cf3-be09-80d6c83eb74e req-2dbecf03-e9e0-419d-84e3-f021ae8d2d53 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updated VIF entry in instance network info cache for port 3fb794e4-d38b-4847-a456-fdbf86f54590. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:32:04 user nova-compute[72803]: DEBUG nova.network.neutron [req-73536e3a-5228-4cf3-be09-80d6c83eb74e req-2dbecf03-e9e0-419d-84e3-f021ae8d2d53 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updating instance_info_cache with network_info: [{"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:32:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-73536e3a-5228-4cf3-be09-80d6c83eb74e req-2dbecf03-e9e0-419d-84e3-f021ae8d2d53 service nova] Releasing lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:32:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:32:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:05 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:06 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:07 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:32:07 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=25.272274017333984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a9abe053-d27e-468e-9828-d7a16a2aef21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 6a29d336-455e-4e04-a3cd-6a86ce8c25bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:32:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:32:08 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:32:08 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:32:08 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:32:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Skipping network cache update for instance because it is Building. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid a9abe053-d27e-468e-9828-d7a16a2aef21 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating instance_info_cache with network_info: [{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:32:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:32:11 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Creating image(s)
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Did not create local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Ensure instance console log exists: /opt/stack/data/nova/instances/6a29d336-455e-4e04-a3cd-6a86ce8c25bc/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Start _get_guest_xml network_info=[{"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'attachment_id': '16471bca-0820-48cc-8acf-37d56a0416f8', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDAapZmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a29d336-455e-4e04-a3cd-6a86ce8c25bc', 'attached_at': '', 'detached_at': '', 'volume_id': '019100af-66f4-4966-994a-72d1a8d16f8c', 'serial': '019100af-66f4-4966-994a-72d1a8d16f8c'}, 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:32:11 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:32:11 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDAapZmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:32:11 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:32:11 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:32:11 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf4f62-807c-4f54-8bdd-2ed306ccc6b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:32:11 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdffc324-9155-4dc8-b38c-b1e5c8e33db2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c] added
Aug 15 07:32:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef832dd-c809-47a9-95d8-170305ef4556]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[459f6d52-d93b-49ce-9d19-e687e6c4f4d5]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDAapZmV {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDAapZmV" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a441f2c7-1195-4cbf-aba1-5afabb658443]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uDAapZmV'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc54527-10ff-483e-95fb-f23f4746d9b2]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6d3ad3-384d-48fc-966e-14cc1c2a5145]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:32:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:32:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbee435-0500-4743-a308-401ec4de1f3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c, portal: 172.16.0.220,3260]
Aug 15 07:32:11 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c, portal: 172.16.0.220,3260] successful.
Aug 15 07:32:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc45172-7dfa-4afd-87c0-fe8b6c452495]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce92e83f-86ca-442c-9691-fb4ac12abc86]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:32:11 user nova-compute[72803]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c (non-flash)
Aug 15 07:32:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:32:11 user nova-compute[72803]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c (non-flash)
Aug 15 07:32:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[83354c34-5194-4982-97f1-32721d29d1a9]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:32:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDAapZmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23861333565633565', 'path': '/dev/sdc'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861333565633565', 'path': '/dev/sdc'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-647552558',display_name='tempest-TestVolumeBootPattern-server-647552558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-647552558',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-sqweta1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:32:02Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=6a29d336-455e-4e04-a3cd-6a86ce8c25bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0d:98,bridge_name='br-int',has_traffic_filtering=True,id=3fb794e4-d38b-4847-a456-fdbf86f54590,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb794e4-d3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a29d336-455e-4e04-a3cd-6a86ce8c25bc {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:32:12 user nova-compute[72803]:   <uuid>6a29d336-455e-4e04-a3cd-6a86ce8c25bc</uuid>
Aug 15 07:32:12 user nova-compute[72803]:   <name>instance-00000032</name>
Aug 15 07:32:12 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:32:12 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:32:12 user nova-compute[72803]:   <metadata>
Aug 15 07:32:12 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:32:12 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:32:12 user nova-compute[72803]:       <nova:name>tempest-TestVolumeBootPattern-server-647552558</nova:name>
Aug 15 07:32:12 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:32:11</nova:creationTime>
Aug 15 07:32:12 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:32:12 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:32:12 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:32:12 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:32:12 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:32:12 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:32:12 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:32:12 user nova-compute[72803]:       <nova:owner>
Aug 15 07:32:12 user nova-compute[72803]:         <nova:user uuid="962292c4846b4ceab2cb00867135e136">tempest-TestVolumeBootPattern-940544162-project-member</nova:user>
Aug 15 07:32:12 user nova-compute[72803]:         <nova:project uuid="9714fffd91c94d79aaa288d93fdfaffa">tempest-TestVolumeBootPattern-940544162</nova:project>
Aug 15 07:32:12 user nova-compute[72803]:       </nova:owner>
Aug 15 07:32:12 user nova-compute[72803]:       <nova:ports>
Aug 15 07:32:12 user nova-compute[72803]:         <nova:port uuid="3fb794e4-d38b-4847-a456-fdbf86f54590">
Aug 15 07:32:12 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 07:32:12 user nova-compute[72803]:         </nova:port>
Aug 15 07:32:12 user nova-compute[72803]:       </nova:ports>
Aug 15 07:32:12 user nova-compute[72803]:     </nova:instance>
Aug 15 07:32:12 user nova-compute[72803]:   </metadata>
Aug 15 07:32:12 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:32:12 user nova-compute[72803]:     <system>
Aug 15 07:32:12 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:32:12 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:32:12 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:32:12 user nova-compute[72803]:       <entry name="serial">6a29d336-455e-4e04-a3cd-6a86ce8c25bc</entry>
Aug 15 07:32:12 user nova-compute[72803]:       <entry name="uuid">6a29d336-455e-4e04-a3cd-6a86ce8c25bc</entry>
Aug 15 07:32:12 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:32:12 user nova-compute[72803]:     </system>
Aug 15 07:32:12 user nova-compute[72803]:   </sysinfo>
Aug 15 07:32:12 user nova-compute[72803]:   <os>
Aug 15 07:32:12 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:32:12 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:32:12 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:32:12 user nova-compute[72803]:   </os>
Aug 15 07:32:12 user nova-compute[72803]:   <features>
Aug 15 07:32:12 user nova-compute[72803]:     <acpi/>
Aug 15 07:32:12 user nova-compute[72803]:     <apic/>
Aug 15 07:32:12 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:32:12 user nova-compute[72803]:   </features>
Aug 15 07:32:12 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:32:12 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:32:12 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:32:12 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:32:12 user nova-compute[72803]:   </clock>
Aug 15 07:32:12 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:32:12 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:32:12 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:32:12 user nova-compute[72803]:   </cpu>
Aug 15 07:32:12 user nova-compute[72803]:   <devices>
Aug 15 07:32:12 user nova-compute[72803]:     <disk type="block" device="disk">
Aug 15 07:32:12 user nova-compute[72803]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:32:12 user nova-compute[72803]:       <source dev="/dev/sdc"/>
Aug 15 07:32:12 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:32:12 user nova-compute[72803]:       <serial>019100af-66f4-4966-994a-72d1a8d16f8c</serial>
Aug 15 07:32:12 user nova-compute[72803]:     </disk>
Aug 15 07:32:12 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:32:12 user nova-compute[72803]:       <mac address="fa:16:3e:0d:0d:98"/>
Aug 15 07:32:12 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:32:12 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:32:12 user nova-compute[72803]:       <target dev="tap3fb794e4-d3"/>
Aug 15 07:32:12 user nova-compute[72803]:     </interface>
Aug 15 07:32:12 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:32:12 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/6a29d336-455e-4e04-a3cd-6a86ce8c25bc/console.log" append="off"/>
Aug 15 07:32:12 user nova-compute[72803]:     </serial>
Aug 15 07:32:12 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:32:12 user nova-compute[72803]:     <video>
Aug 15 07:32:12 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:32:12 user nova-compute[72803]:     </video>
Aug 15 07:32:12 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:32:12 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:32:12 user nova-compute[72803]:     </rng>
Aug 15 07:32:12 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:32:12 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:32:12 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:32:12 user nova-compute[72803]:     </memballoon>
Aug 15 07:32:12 user nova-compute[72803]:   </devices>
Aug 15 07:32:12 user nova-compute[72803]: </domain>
Aug 15 07:32:12 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-647552558',display_name='tempest-TestVolumeBootPattern-server-647552558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-647552558',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-sqweta1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:32:02Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=6a29d336-455e-4e04-a3cd-6a86ce8c25bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0d:98,bridge_name='br-int',has_traffic_filtering=True,id=3fb794e4-d38b-4847-a456-fdbf86f54590,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb794e4-d3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG os_vif [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0d:98,bridge_name='br-int',has_traffic_filtering=True,id=3fb794e4-d38b-4847-a456-fdbf86f54590,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb794e4-d3') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fb794e4-d3, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fb794e4-d3, col_values=(('external_ids', {'iface-id': '3fb794e4-d38b-4847-a456-fdbf86f54590', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:0d:98', 'vm-uuid': '6a29d336-455e-4e04-a3cd-6a86ce8c25bc'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:12 user nova-compute[72803]: INFO os_vif [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0d:98,bridge_name='br-int',has_traffic_filtering=True,id=3fb794e4-d38b-4847-a456-fdbf86f54590,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb794e4-d3')
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:32:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] No VIF found with MAC fa:16:3e:0d:0d:98, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:32:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-a35469b2-7e82-452e-92b4-34614df23d13 req-125b95de-ef86-4b3a-8c92-3133f33524b3 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:32:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a35469b2-7e82-452e-92b4-34614df23d13 req-125b95de-ef86-4b3a-8c92-3133f33524b3 service nova] Acquiring lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a35469b2-7e82-452e-92b4-34614df23d13 req-125b95de-ef86-4b3a-8c92-3133f33524b3 service nova] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-a35469b2-7e82-452e-92b4-34614df23d13 req-125b95de-ef86-4b3a-8c92-3133f33524b3 service nova] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-a35469b2-7e82-452e-92b4-34614df23d13 req-125b95de-ef86-4b3a-8c92-3133f33524b3 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] No waiting events found dispatching network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:32:13 user nova-compute[72803]: WARNING nova.compute.manager [req-a35469b2-7e82-452e-92b4-34614df23d13 req-125b95de-ef86-4b3a-8c92-3133f33524b3 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received unexpected event network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 for instance with vm_state building and task_state spawning.
Aug 15 07:32:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084735.9125514, 6a29d336-455e-4e04-a3cd-6a86ce8c25bc => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:32:15 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] VM Resumed (Lifecycle Event)
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:32:15 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Instance spawned successfully.
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:32:15 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084735.9144688, 6a29d336-455e-4e04-a3cd-6a86ce8c25bc => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:32:15 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] VM Started (Lifecycle Event)
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:32:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:32:16 user nova-compute[72803]: INFO nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 15 07:32:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:32:16 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:32:16 user nova-compute[72803]: DEBUG nova.compute.manager [req-68748b77-8caa-4d5d-86e1-41eb883f2f97 req-7c6fbe90-e597-47fc-b624-2746c9515c18 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:32:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-68748b77-8caa-4d5d-86e1-41eb883f2f97 req-7c6fbe90-e597-47fc-b624-2746c9515c18 service nova] Acquiring lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-68748b77-8caa-4d5d-86e1-41eb883f2f97 req-7c6fbe90-e597-47fc-b624-2746c9515c18 service nova] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-68748b77-8caa-4d5d-86e1-41eb883f2f97 req-7c6fbe90-e597-47fc-b624-2746c9515c18 service nova] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:16 user nova-compute[72803]: DEBUG nova.compute.manager [req-68748b77-8caa-4d5d-86e1-41eb883f2f97 req-7c6fbe90-e597-47fc-b624-2746c9515c18 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] No waiting events found dispatching network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:32:16 user nova-compute[72803]: WARNING nova.compute.manager [req-68748b77-8caa-4d5d-86e1-41eb883f2f97 req-7c6fbe90-e597-47fc-b624-2746c9515c18 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received unexpected event network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 for instance with vm_state building and task_state spawning.
Aug 15 07:32:16 user nova-compute[72803]: INFO nova.compute.manager [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Took 14.35 seconds to build instance.
Aug 15 07:32:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1b47f04e-90ed-495b-987c-d70194a0347a tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.523s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:17 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:18 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:32:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:32:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:32:22 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:32:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:32 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:37 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:42 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:47 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:32:55 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:32:58 user nova-compute[72803]: INFO nova.compute.claims [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Claim successful on node user
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.network.neutron [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:32:58 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.policy [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ded0c369e6364afbafd178ddc2d0ec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354415c38b24e8ea507ff68916ffa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:32:58 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Creating image(s)
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "/opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "/opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.190s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk 1073741824" returned: 0 in 0.057s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.181s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Cannot resize image /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG nova.objects.instance [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lazy-loading 'migration_context' on Instance uuid ec775934-d66c-4dcd-a978-b1c15ca3a5af {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG nova.network.neutron [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Successfully created port: 110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Ensure instance console log exists: /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:32:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Successfully updated port: 110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "refresh_cache-ec775934-d66c-4dcd-a978-b1c15ca3a5af" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquired lock "refresh_cache-ec775934-d66c-4dcd-a978-b1c15ca3a5af" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-745d271c-04b9-419a-a269-7f8624a5c0fc req-7792c6b4-b496-4e66-a5a8-ad854671d175 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-changed-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-745d271c-04b9-419a-a269-7f8624a5c0fc req-7792c6b4-b496-4e66-a5a8-ad854671d175 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Refreshing instance network info cache due to event network-changed-110e728d-76ae-4576-9682-c13c30fe58c3. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-745d271c-04b9-419a-a269-7f8624a5c0fc req-7792c6b4-b496-4e66-a5a8-ad854671d175 service nova] Acquiring lock "refresh_cache-ec775934-d66c-4dcd-a978-b1c15ca3a5af" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_power_states {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:00 user nova-compute[72803]: WARNING nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid a9abe053-d27e-468e-9828-d7a16a2aef21 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 98b88fe2-798c-4160-b698-1680d220da81 {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 6a29d336-455e-4e04-a3cd-6a86ce8c25bc {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid ec775934-d66c-4dcd-a978-b1c15ca3a5af {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "a9abe053-d27e-468e-9828-d7a16a2aef21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "98b88fe2-798c-4160-b698-1680d220da81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "98b88fe2-798c-4160-b698-1680d220da81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "98b88fe2-798c-4160-b698-1680d220da81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.neutron [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Updating instance_info_cache with network_info: [{"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Releasing lock "refresh_cache-ec775934-d66c-4dcd-a978-b1c15ca3a5af" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Instance network_info: |[{"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-745d271c-04b9-419a-a269-7f8624a5c0fc req-7792c6b4-b496-4e66-a5a8-ad854671d175 service nova] Acquired lock "refresh_cache-ec775934-d66c-4dcd-a978-b1c15ca3a5af" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.neutron [req-745d271c-04b9-419a-a269-7f8624a5c0fc req-7792c6b4-b496-4e66-a5a8-ad854671d175 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Refreshing network info cache for port 110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Start _get_guest_xml network_info=[{"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:33:00 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:33:00 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-676188549',display_name='tempest-ServersNegativeTestJSON-server-676188549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-676188549',id=51,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5354415c38b24e8ea507ff68916ffa43',ramdisk_id='',reservation_id='r-r29477ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-387859981',owner_user_name='tempest-ServersNegativeTestJSON-387859981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:32:59Z,user_data=None,user_id='ded0c369e6364afbafd178ddc2d0ec74',uuid=ec775934-d66c-4dcd-a978-b1c15ca3a5af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converting VIF {"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f8:d2,bridge_name='br-int',has_traffic_filtering=True,id=110e728d-76ae-4576-9682-c13c30fe58c3,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e728d-76') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lazy-loading 'pci_devices' on Instance uuid ec775934-d66c-4dcd-a978-b1c15ca3a5af {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:33:00 user nova-compute[72803]:   <uuid>ec775934-d66c-4dcd-a978-b1c15ca3a5af</uuid>
Aug 15 07:33:00 user nova-compute[72803]:   <name>instance-00000033</name>
Aug 15 07:33:00 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:33:00 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:33:00 user nova-compute[72803]:   <metadata>
Aug 15 07:33:00 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:33:00 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:33:00 user nova-compute[72803]:       <nova:name>tempest-ServersNegativeTestJSON-server-676188549</nova:name>
Aug 15 07:33:00 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:33:00</nova:creationTime>
Aug 15 07:33:00 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:33:00 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:33:00 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:33:00 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:33:00 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:33:00 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:33:00 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:33:00 user nova-compute[72803]:       <nova:owner>
Aug 15 07:33:00 user nova-compute[72803]:         <nova:user uuid="ded0c369e6364afbafd178ddc2d0ec74">tempest-ServersNegativeTestJSON-387859981-project-member</nova:user>
Aug 15 07:33:00 user nova-compute[72803]:         <nova:project uuid="5354415c38b24e8ea507ff68916ffa43">tempest-ServersNegativeTestJSON-387859981</nova:project>
Aug 15 07:33:00 user nova-compute[72803]:       </nova:owner>
Aug 15 07:33:00 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:33:00 user nova-compute[72803]:       <nova:ports>
Aug 15 07:33:00 user nova-compute[72803]:         <nova:port uuid="110e728d-76ae-4576-9682-c13c30fe58c3">
Aug 15 07:33:00 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 07:33:00 user nova-compute[72803]:         </nova:port>
Aug 15 07:33:00 user nova-compute[72803]:       </nova:ports>
Aug 15 07:33:00 user nova-compute[72803]:     </nova:instance>
Aug 15 07:33:00 user nova-compute[72803]:   </metadata>
Aug 15 07:33:00 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:33:00 user nova-compute[72803]:     <system>
Aug 15 07:33:00 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:33:00 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:33:00 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:33:00 user nova-compute[72803]:       <entry name="serial">ec775934-d66c-4dcd-a978-b1c15ca3a5af</entry>
Aug 15 07:33:00 user nova-compute[72803]:       <entry name="uuid">ec775934-d66c-4dcd-a978-b1c15ca3a5af</entry>
Aug 15 07:33:00 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:33:00 user nova-compute[72803]:     </system>
Aug 15 07:33:00 user nova-compute[72803]:   </sysinfo>
Aug 15 07:33:00 user nova-compute[72803]:   <os>
Aug 15 07:33:00 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:33:00 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:33:00 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:33:00 user nova-compute[72803]:   </os>
Aug 15 07:33:00 user nova-compute[72803]:   <features>
Aug 15 07:33:00 user nova-compute[72803]:     <acpi/>
Aug 15 07:33:00 user nova-compute[72803]:     <apic/>
Aug 15 07:33:00 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:33:00 user nova-compute[72803]:   </features>
Aug 15 07:33:00 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:33:00 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:33:00 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:33:00 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:33:00 user nova-compute[72803]:   </clock>
Aug 15 07:33:00 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:33:00 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:33:00 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:33:00 user nova-compute[72803]:   </cpu>
Aug 15 07:33:00 user nova-compute[72803]:   <devices>
Aug 15 07:33:00 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:33:00 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:33:00 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk"/>
Aug 15 07:33:00 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:33:00 user nova-compute[72803]:     </disk>
Aug 15 07:33:00 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:33:00 user nova-compute[72803]:       <mac address="fa:16:3e:41:f8:d2"/>
Aug 15 07:33:00 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:33:00 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:33:00 user nova-compute[72803]:       <target dev="tap110e728d-76"/>
Aug 15 07:33:00 user nova-compute[72803]:     </interface>
Aug 15 07:33:00 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:33:00 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/console.log" append="off"/>
Aug 15 07:33:00 user nova-compute[72803]:     </serial>
Aug 15 07:33:00 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:33:00 user nova-compute[72803]:     <video>
Aug 15 07:33:00 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:33:00 user nova-compute[72803]:     </video>
Aug 15 07:33:00 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:33:00 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:33:00 user nova-compute[72803]:     </rng>
Aug 15 07:33:00 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:33:00 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:33:00 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:33:00 user nova-compute[72803]:     </memballoon>
Aug 15 07:33:00 user nova-compute[72803]:   </devices>
Aug 15 07:33:00 user nova-compute[72803]: </domain>
Aug 15 07:33:00 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-676188549',display_name='tempest-ServersNegativeTestJSON-server-676188549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-676188549',id=51,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5354415c38b24e8ea507ff68916ffa43',ramdisk_id='',reservation_id='r-r29477ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-387859981',owner_user_name='tempest-ServersNegativeTestJSON-387859981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:32:59Z,user_data=None,user_id='ded0c369e6364afbafd178ddc2d0ec74',uuid=ec775934-d66c-4dcd-a978-b1c15ca3a5af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converting VIF {"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f8:d2,bridge_name='br-int',has_traffic_filtering=True,id=110e728d-76ae-4576-9682-c13c30fe58c3,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e728d-76') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG os_vif [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f8:d2,bridge_name='br-int',has_traffic_filtering=True,id=110e728d-76ae-4576-9682-c13c30fe58c3,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e728d-76') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap110e728d-76, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap110e728d-76, col_values=(('external_ids', {'iface-id': '110e728d-76ae-4576-9682-c13c30fe58c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:f8:d2', 'vm-uuid': 'ec775934-d66c-4dcd-a978-b1c15ca3a5af'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:00 user nova-compute[72803]: INFO os_vif [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f8:d2,bridge_name='br-int',has_traffic_filtering=True,id=110e728d-76ae-4576-9682-c13c30fe58c3,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e728d-76')
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:33:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] No VIF found with MAC fa:16:3e:41:f8:d2, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:33:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-745d271c-04b9-419a-a269-7f8624a5c0fc req-7792c6b4-b496-4e66-a5a8-ad854671d175 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Updated VIF entry in instance network info cache for port 110e728d-76ae-4576-9682-c13c30fe58c3. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:33:01 user nova-compute[72803]: DEBUG nova.network.neutron [req-745d271c-04b9-419a-a269-7f8624a5c0fc req-7792c6b4-b496-4e66-a5a8-ad854671d175 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Updating instance_info_cache with network_info: [{"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:33:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-745d271c-04b9-419a-a269-7f8624a5c0fc req-7792c6b4-b496-4e66-a5a8-ad854671d175 service nova] Releasing lock "refresh_cache-ec775934-d66c-4dcd-a978-b1c15ca3a5af" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ca98db7-aac2-4dca-ba8e-67d2edffeaa7 req-2e5b3a27-5c62-4698-a497-ad2c44264fe4 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ca98db7-aac2-4dca-ba8e-67d2edffeaa7 req-2e5b3a27-5c62-4698-a497-ad2c44264fe4 service nova] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ca98db7-aac2-4dca-ba8e-67d2edffeaa7 req-2e5b3a27-5c62-4698-a497-ad2c44264fe4 service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-2ca98db7-aac2-4dca-ba8e-67d2edffeaa7 req-2e5b3a27-5c62-4698-a497-ad2c44264fe4 service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-2ca98db7-aac2-4dca-ba8e-67d2edffeaa7 req-2e5b3a27-5c62-4698-a497-ad2c44264fe4 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] No waiting events found dispatching network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:33:02 user nova-compute[72803]: WARNING nova.compute.manager [req-2ca98db7-aac2-4dca-ba8e-67d2edffeaa7 req-2e5b3a27-5c62-4698-a497-ad2c44264fe4 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received unexpected event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 for instance with vm_state building and task_state spawning.
Aug 15 07:33:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084784.1650739, ec775934-d66c-4dcd-a978-b1c15ca3a5af => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:33:04 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] VM Resumed (Lifecycle Event)
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:33:04 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Instance spawned successfully.
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:33:04 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692084784.1663647, ec775934-d66c-4dcd-a978-b1c15ca3a5af => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:33:04 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] VM Started (Lifecycle Event)
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:33:04 user nova-compute[72803]: INFO nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:33:04 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-8f6a7c61-0d2f-477e-8e41-349c841a0c0d req-b55cd1cf-8353-4146-bf7e-df908ee28d17 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8f6a7c61-0d2f-477e-8e41-349c841a0c0d req-b55cd1cf-8353-4146-bf7e-df908ee28d17 service nova] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8f6a7c61-0d2f-477e-8e41-349c841a0c0d req-b55cd1cf-8353-4146-bf7e-df908ee28d17 service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8f6a7c61-0d2f-477e-8e41-349c841a0c0d req-b55cd1cf-8353-4146-bf7e-df908ee28d17 service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [req-8f6a7c61-0d2f-477e-8e41-349c841a0c0d req-b55cd1cf-8353-4146-bf7e-df908ee28d17 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] No waiting events found dispatching network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:33:04 user nova-compute[72803]: WARNING nova.compute.manager [req-8f6a7c61-0d2f-477e-8e41-349c841a0c0d req-b55cd1cf-8353-4146-bf7e-df908ee28d17 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received unexpected event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 for instance with vm_state building and task_state spawning.
Aug 15 07:33:04 user nova-compute[72803]: INFO nova.compute.manager [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Took 6.10 seconds to build instance.
Aug 15 07:33:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-40470ed5-1448-4b06-b59b-942fb5fa946d tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.194s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.753s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:04 user nova-compute[72803]: INFO nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:33:04 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:33:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updating instance_info_cache with network_info: [{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:33:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:10 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:33:10 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=25.269805908203125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a9abe053-d27e-468e-9828-d7a16a2aef21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 6a29d336-455e-4e04-a3cd-6a86ce8c25bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ec775934-d66c-4dcd-a978-b1c15ca3a5af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:33:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:33:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:33:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:33:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:33:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:33:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-59a0bcbc-a16f-4133-99c4-a84a5475535f req-6df011bc-ad4e-4817-b412-fc74a7d62a85 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-changed-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:33:53 user nova-compute[72803]: DEBUG nova.compute.manager [req-59a0bcbc-a16f-4133-99c4-a84a5475535f req-6df011bc-ad4e-4817-b412-fc74a7d62a85 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Refreshing instance network info cache due to event network-changed-3fb794e4-d38b-4847-a456-fdbf86f54590. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:33:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-59a0bcbc-a16f-4133-99c4-a84a5475535f req-6df011bc-ad4e-4817-b412-fc74a7d62a85 service nova] Acquiring lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:33:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-59a0bcbc-a16f-4133-99c4-a84a5475535f req-6df011bc-ad4e-4817-b412-fc74a7d62a85 service nova] Acquired lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:33:53 user nova-compute[72803]: DEBUG nova.network.neutron [req-59a0bcbc-a16f-4133-99c4-a84a5475535f req-6df011bc-ad4e-4817-b412-fc74a7d62a85 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Refreshing network info cache for port 3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:33:53 user nova-compute[72803]: DEBUG nova.network.neutron [req-59a0bcbc-a16f-4133-99c4-a84a5475535f req-6df011bc-ad4e-4817-b412-fc74a7d62a85 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updated VIF entry in instance network info cache for port 3fb794e4-d38b-4847-a456-fdbf86f54590. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:33:53 user nova-compute[72803]: DEBUG nova.network.neutron [req-59a0bcbc-a16f-4133-99c4-a84a5475535f req-6df011bc-ad4e-4817-b412-fc74a7d62a85 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updating instance_info_cache with network_info: [{"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:33:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-59a0bcbc-a16f-4133-99c4-a84a5475535f req-6df011bc-ad4e-4817-b412-fc74a7d62a85 service nova] Releasing lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-5dc01e98-1825-4922-836e-bdeb3b46ee8c req-9bfe034c-2414-4b1e-a2b8-ac95ae59eaa1 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-changed-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG nova.compute.manager [req-5dc01e98-1825-4922-836e-bdeb3b46ee8c req-9bfe034c-2414-4b1e-a2b8-ac95ae59eaa1 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Refreshing instance network info cache due to event network-changed-3fb794e4-d38b-4847-a456-fdbf86f54590. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5dc01e98-1825-4922-836e-bdeb3b46ee8c req-9bfe034c-2414-4b1e-a2b8-ac95ae59eaa1 service nova] Acquiring lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5dc01e98-1825-4922-836e-bdeb3b46ee8c req-9bfe034c-2414-4b1e-a2b8-ac95ae59eaa1 service nova] Acquired lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG nova.network.neutron [req-5dc01e98-1825-4922-836e-bdeb3b46ee8c req-9bfe034c-2414-4b1e-a2b8-ac95ae59eaa1 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Refreshing network info cache for port 3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:54 user nova-compute[72803]: INFO nova.compute.manager [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Terminating instance
Aug 15 07:33:54 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG nova.network.neutron [req-5dc01e98-1825-4922-836e-bdeb3b46ee8c req-9bfe034c-2414-4b1e-a2b8-ac95ae59eaa1 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updated VIF entry in instance network info cache for port 3fb794e4-d38b-4847-a456-fdbf86f54590. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG nova.network.neutron [req-5dc01e98-1825-4922-836e-bdeb3b46ee8c req-9bfe034c-2414-4b1e-a2b8-ac95ae59eaa1 service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updating instance_info_cache with network_info: [{"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-5dc01e98-1825-4922-836e-bdeb3b46ee8c req-9bfe034c-2414-4b1e-a2b8-ac95ae59eaa1 service nova] Releasing lock "refresh_cache-6a29d336-455e-4e04-a3cd-6a86ce8c25bc" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:33:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Instance destroyed successfully.
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.objects.instance [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'resources' on Instance uuid 6a29d336-455e-4e04-a3cd-6a86ce8c25bc {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-647552558',display_name='tempest-TestVolumeBootPattern-server-647552558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-647552558',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-sqweta1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:32:16Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=6a29d336-455e-4e04-a3cd-6a86ce8c25bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "3fb794e4-d38b-4847-a456-fdbf86f54590", "address": "fa:16:3e:0d:0d:98", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb794e4-d3", "ovs_interfaceid": "3fb794e4-d38b-4847-a456-fdbf86f54590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0d:98,bridge_name='br-int',has_traffic_filtering=True,id=3fb794e4-d38b-4847-a456-fdbf86f54590,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb794e4-d3') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_vif [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0d:98,bridge_name='br-int',has_traffic_filtering=True,id=3fb794e4-d38b-4847-a456-fdbf86f54590,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb794e4-d3') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fb794e4-d3, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:33:55 user nova-compute[72803]: INFO os_vif [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0d:98,bridge_name='br-int',has_traffic_filtering=True,id=3fb794e4-d38b-4847-a456-fdbf86f54590,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb794e4-d3')
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDAapZmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:33:55 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5fa905-c290-413c-91c3-e50095e02c78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c67e3fa-3033-4242-8129-70c9aa216dbd]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:33:55 user nova-compute[72803]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c (non-flash)
Aug 15 07:33:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:33:55 user nova-compute[72803]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c (non-flash)
Aug 15 07:33:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c05ebeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c'): ({'sdc'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Removing single pathed devices sdc {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d899962-dbf6-4814-a6e5-b62fc5f484de]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab13a44f-9394-4b4c-b81f-f534b47a650b]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flushing IO for device /dev/sdc {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb7058b-0bc8-49c3-ba68-4ff6ef33d3d8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d32edeb-4bd9-4598-b2b4-44b284109c53]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] SCSI volumes sdc have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2f4833-7fd0-4bff-aced-77d0be6f98fa]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25919bc-d095-45d3-93a9-bdd8189da951]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c, portal: 172.16.0.220,3260]
Aug 15 07:33:55 user nova-compute[72803]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c, portal: 172.16.0.220,3260] successful.
Aug 15 07:33:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:019100af-66f4-4966-994a-72d1a8d16f8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edf0572-3322-40d7-9a61-45ccc6813170]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== disconnect_volume: return (287ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:33:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Deleting instance files /opt/stack/data/nova/instances/6a29d336-455e-4e04-a3cd-6a86ce8c25bc_del
Aug 15 07:33:55 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Deletion of /opt/stack/data/nova/instances/6a29d336-455e-4e04-a3cd-6a86ce8c25bc_del complete
Aug 15 07:33:55 user nova-compute[72803]: INFO nova.compute.manager [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 15 07:33:55 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:33:55 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Took 0.49 seconds to deallocate network for instance.
Aug 15 07:33:55 user nova-compute[72803]: DEBUG nova.compute.manager [req-81baaf04-cdd2-411d-bd70-609fa50e3070 req-1a9676d1-625f-41ea-81d7-5f79a0903dfd service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-vif-deleted-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-vif-unplugged-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] Acquiring lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] No waiting events found dispatching network-vif-unplugged-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-vif-unplugged-3fb794e4-d38b-4847-a456-fdbf86f54590 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received event network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] Acquiring lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG nova.compute.manager [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] No waiting events found dispatching network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:33:56 user nova-compute[72803]: WARNING nova.compute.manager [req-99389c11-84f9-462b-8929-cc94b0c25c23 req-b31ea602-d34d-438d-837b-f59e6ab3e54f service nova] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Received unexpected event network-vif-plugged-3fb794e4-d38b-4847-a456-fdbf86f54590 for instance with vm_state active and task_state deleting.
Aug 15 07:33:56 user nova-compute[72803]: INFO nova.compute.manager [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Took 0.77 seconds to detach 1 volumes for instance.
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:33:56 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:56 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Deleted allocations for instance 6a29d336-455e-4e04-a3cd-6a86ce8c25bc
Aug 15 07:33:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-1ed3b942-fa61-4371-b973-2d08f7ce97d1 tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "6a29d336-455e-4e04-a3cd-6a86ce8c25bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:33:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:33:59 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:04 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:34:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:05 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:07 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:09 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084835.0481734, 6a29d336-455e-4e04-a3cd-6a86ce8c25bc => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:34:10 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] VM Stopped (Lifecycle Event)
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.manager [None req-1cf2ff07-86ae-437d-97bc-3753e5d78cc0 None None] [instance: 6a29d336-455e-4e04-a3cd-6a86ce8c25bc] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:10 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:34:10 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8583MB free_disk=25.241073608398438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance a9abe053-d27e-468e-9828-d7a16a2aef21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance ec775934-d66c-4dcd-a978-b1c15ca3a5af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:34:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:34:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:34:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:34:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:34:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:34:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid a9abe053-d27e-468e-9828-d7a16a2aef21 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:34:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating instance_info_cache with network_info: [{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:34:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:34:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:34:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:34:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:34:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:34:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:34:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:48 user nova-compute[72803]: INFO nova.compute.manager [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Terminating instance
Aug 15 07:34:48 user nova-compute[72803]: DEBUG nova.compute.manager [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-ffb1a524-8faa-4c90-ad8f-2a5387dd5d81 req-e5cc51a6-736a-4aa6-b121-bf4fe677d0b2 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-vif-unplugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ffb1a524-8faa-4c90-ad8f-2a5387dd5d81 req-e5cc51a6-736a-4aa6-b121-bf4fe677d0b2 service nova] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ffb1a524-8faa-4c90-ad8f-2a5387dd5d81 req-e5cc51a6-736a-4aa6-b121-bf4fe677d0b2 service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-ffb1a524-8faa-4c90-ad8f-2a5387dd5d81 req-e5cc51a6-736a-4aa6-b121-bf4fe677d0b2 service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-ffb1a524-8faa-4c90-ad8f-2a5387dd5d81 req-e5cc51a6-736a-4aa6-b121-bf4fe677d0b2 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] No waiting events found dispatching network-vif-unplugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG nova.compute.manager [req-ffb1a524-8faa-4c90-ad8f-2a5387dd5d81 req-e5cc51a6-736a-4aa6-b121-bf4fe677d0b2 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-vif-unplugged-110e728d-76ae-4576-9682-c13c30fe58c3 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Instance destroyed successfully.
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lazy-loading 'resources' on Instance uuid ec775934-d66c-4dcd-a978-b1c15ca3a5af {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-676188549',display_name='tempest-ServersNegativeTestJSON-server-676188549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-676188549',id=51,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:33:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5354415c38b24e8ea507ff68916ffa43',ramdisk_id='',reservation_id='r-r29477ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-387859981',owner_user_name='tempest-ServersNegativeTestJSON-387859981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:33:04Z,user_data=None,user_id='ded0c369e6364afbafd178ddc2d0ec74',uuid=ec775934-d66c-4dcd-a978-b1c15ca3a5af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converting VIF {"id": "110e728d-76ae-4576-9682-c13c30fe58c3", "address": "fa:16:3e:41:f8:d2", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap110e728d-76", "ovs_interfaceid": "110e728d-76ae-4576-9682-c13c30fe58c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f8:d2,bridge_name='br-int',has_traffic_filtering=True,id=110e728d-76ae-4576-9682-c13c30fe58c3,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e728d-76') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG os_vif [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f8:d2,bridge_name='br-int',has_traffic_filtering=True,id=110e728d-76ae-4576-9682-c13c30fe58c3,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e728d-76') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap110e728d-76, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:34:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:34:48 user nova-compute[72803]: INFO os_vif [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f8:d2,bridge_name='br-int',has_traffic_filtering=True,id=110e728d-76ae-4576-9682-c13c30fe58c3,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap110e728d-76')
Aug 15 07:34:48 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Deleting instance files /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af_del
Aug 15 07:34:48 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Deletion of /opt/stack/data/nova/instances/ec775934-d66c-4dcd-a978-b1c15ca3a5af_del complete
Aug 15 07:34:49 user nova-compute[72803]: INFO nova.compute.manager [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 07:34:49 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:34:49 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Took 0.46 seconds to deallocate network for instance.
Aug 15 07:34:49 user nova-compute[72803]: DEBUG nova.compute.manager [req-a2f80f43-ce80-4179-babf-ab61b4232893 req-e7b47947-5da8-44de-93a1-9b6673866383 service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-vif-deleted-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:34:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:49 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Deleted allocations for instance ec775934-d66c-4dcd-a978-b1c15ca3a5af
Aug 15 07:34:49 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2faf2184-d7c1-4eea-a7ee-95822f7c8cf8 tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.531s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] No waiting events found dispatching network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:34:50 user nova-compute[72803]: WARNING nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received unexpected event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 for instance with vm_state deleted and task_state None.
Aug 15 07:34:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] No waiting events found dispatching network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:34:50 user nova-compute[72803]: WARNING nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received unexpected event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 for instance with vm_state deleted and task_state None.
Aug 15 07:34:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Acquiring lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] Lock "ec775934-d66c-4dcd-a978-b1c15ca3a5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:50 user nova-compute[72803]: DEBUG nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] No waiting events found dispatching network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:34:50 user nova-compute[72803]: WARNING nova.compute.manager [req-71f60b67-1fb1-4a2a-9aaa-304fdf8ae4c5 req-8419110f-df7e-41a7-abbc-e06702a9b98d service nova] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Received unexpected event network-vif-plugged-110e728d-76ae-4576-9682-c13c30fe58c3 for instance with vm_state deleted and task_state None.
Aug 15 07:34:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-6b662eaa-8ae0-4b9b-8b7b-4abda44d9d83 req-712c85d5-6601-4e29-9cb5-78fbccd4d625 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-changed-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-6b662eaa-8ae0-4b9b-8b7b-4abda44d9d83 req-712c85d5-6601-4e29-9cb5-78fbccd4d625 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Refreshing instance network info cache due to event network-changed-df7354a5-4cc5-41e1-8667-d01a943b7032. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6b662eaa-8ae0-4b9b-8b7b-4abda44d9d83 req-712c85d5-6601-4e29-9cb5-78fbccd4d625 service nova] Acquiring lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6b662eaa-8ae0-4b9b-8b7b-4abda44d9d83 req-712c85d5-6601-4e29-9cb5-78fbccd4d625 service nova] Acquired lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-6b662eaa-8ae0-4b9b-8b7b-4abda44d9d83 req-712c85d5-6601-4e29-9cb5-78fbccd4d625 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Refreshing network info cache for port df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "a9abe053-d27e-468e-9828-d7a16a2aef21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:57 user nova-compute[72803]: INFO nova.compute.manager [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Terminating instance
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.compute.manager [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-6b662eaa-8ae0-4b9b-8b7b-4abda44d9d83 req-712c85d5-6601-4e29-9cb5-78fbccd4d625 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updated VIF entry in instance network info cache for port df7354a5-4cc5-41e1-8667-d01a943b7032. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.network.neutron [req-6b662eaa-8ae0-4b9b-8b7b-4abda44d9d83 req-712c85d5-6601-4e29-9cb5-78fbccd4d625 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating instance_info_cache with network_info: [{"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6b662eaa-8ae0-4b9b-8b7b-4abda44d9d83 req-712c85d5-6601-4e29-9cb5-78fbccd4d625 service nova] Releasing lock "refresh_cache-a9abe053-d27e-468e-9828-d7a16a2aef21" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-553e59af-5948-4783-9dc5-e91a1fa4aee9 req-cd160fec-ea9f-48fc-8a73-2e010b61de97 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-vif-unplugged-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-553e59af-5948-4783-9dc5-e91a1fa4aee9 req-cd160fec-ea9f-48fc-8a73-2e010b61de97 service nova] Acquiring lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-553e59af-5948-4783-9dc5-e91a1fa4aee9 req-cd160fec-ea9f-48fc-8a73-2e010b61de97 service nova] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-553e59af-5948-4783-9dc5-e91a1fa4aee9 req-cd160fec-ea9f-48fc-8a73-2e010b61de97 service nova] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-553e59af-5948-4783-9dc5-e91a1fa4aee9 req-cd160fec-ea9f-48fc-8a73-2e010b61de97 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] No waiting events found dispatching network-vif-unplugged-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:34:57 user nova-compute[72803]: DEBUG nova.compute.manager [req-553e59af-5948-4783-9dc5-e91a1fa4aee9 req-cd160fec-ea9f-48fc-8a73-2e010b61de97 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-vif-unplugged-df7354a5-4cc5-41e1-8667-d01a943b7032 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:34:58 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Instance destroyed successfully.
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.objects.instance [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lazy-loading 'resources' on Instance uuid a9abe053-d27e-468e-9828-d7a16a2aef21 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:29:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-103247724',display_name='tempest-TestVolumeBootPattern-server-103247724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-103247724',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1edCLmcpfqIfm1Vyr+83CzdICFj4AbzGFrDDfWJfid78NP+KwLEqAgxsk2bXUvjEJiA0kyNwRwEHGyEUurPpj1z75fqJn/vD2odicJ7L9Se4s3tGtI1wdw42Mxh19jw==',key_name='tempest-TestVolumeBootPattern-1999291631',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9714fffd91c94d79aaa288d93fdfaffa',ramdisk_id='',reservation_id='r-a87re049',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-940544162',owner_user_name='tempest-TestVolumeBootPattern-940544162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:30:11Z,user_data=None,user_id='962292c4846b4ceab2cb00867135e136',uuid=a9abe053-d27e-468e-9828-d7a16a2aef21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converting VIF {"id": "df7354a5-4cc5-41e1-8667-d01a943b7032", "address": "fa:16:3e:ea:50:84", "network": {"id": "0d3ee6f3-6f82-421d-8745-3b5ed48e8f53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-695867012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9714fffd91c94d79aaa288d93fdfaffa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf7354a5-4c", "ovs_interfaceid": "df7354a5-4cc5-41e1-8667-d01a943b7032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:50:84,bridge_name='br-int',has_traffic_filtering=True,id=df7354a5-4cc5-41e1-8667-d01a943b7032,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7354a5-4c') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_vif [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:50:84,bridge_name='br-int',has_traffic_filtering=True,id=df7354a5-4cc5-41e1-8667-d01a943b7032,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7354a5-4c') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf7354a5-4c, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:34:58 user nova-compute[72803]: INFO os_vif [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:50:84,bridge_name='br-int',has_traffic_filtering=True,id=df7354a5-4cc5-41e1-8667-d01a943b7032,network=Network(0d3ee6f3-6f82-421d-8745-3b5ed48e8f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf7354a5-4c')
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mhWJGwvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:34:58 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f971c-40d1-4a3d-8fc5-89c6635005fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f5cc3f-db9b-4259-b0d5-19f23b8d8aa2]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:34:58 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 (non-flash)
Aug 15 07:34:58 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c0779630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[05625cf2-5d41-4840-a0ca-98ba853af353]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18fd6a9-556d-46b1-abe2-27177f34b8d4]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0582769-fe50-42c8-91cf-b110b8c18d35]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e25143-f17d-46b6-adcd-63fb3576a773]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b0d588-646c-4862-aab5-b4d010e5aea3]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5414f4b4-f555-45f1-a4db-5cf207106c0a]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260]
Aug 15 07:34:58 user nova-compute[72803]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90, portal: 172.16.0.220,3260] successful.
Aug 15 07:34:58 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7850018b-961e-4b7e-bc3c-92f2a09e1f90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0991147-74eb-4dc4-b135-b631859f97d1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] <== disconnect_volume: return (283ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:34:58 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Deleting instance files /opt/stack/data/nova/instances/a9abe053-d27e-468e-9828-d7a16a2aef21_del
Aug 15 07:34:58 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Deletion of /opt/stack/data/nova/instances/a9abe053-d27e-468e-9828-d7a16a2aef21_del complete
Aug 15 07:34:58 user nova-compute[72803]: INFO nova.compute.manager [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 15 07:34:58 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:34:58 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Took 0.50 seconds to deallocate network for instance.
Aug 15 07:34:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-8d62ec58-8a2a-43f1-b332-411ff7686992 req-bf56c90d-373b-40d9-9c9e-5de10f153fba service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-vif-deleted-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-599a3d14-ef90-4d69-b833-ac5aaebb29ed req-d09987eb-aa6e-43a3-b5cc-ad22639f03b5 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received event network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-599a3d14-ef90-4d69-b833-ac5aaebb29ed req-d09987eb-aa6e-43a3-b5cc-ad22639f03b5 service nova] Acquiring lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-599a3d14-ef90-4d69-b833-ac5aaebb29ed req-d09987eb-aa6e-43a3-b5cc-ad22639f03b5 service nova] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-599a3d14-ef90-4d69-b833-ac5aaebb29ed req-d09987eb-aa6e-43a3-b5cc-ad22639f03b5 service nova] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG nova.compute.manager [req-599a3d14-ef90-4d69-b833-ac5aaebb29ed req-d09987eb-aa6e-43a3-b5cc-ad22639f03b5 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] No waiting events found dispatching network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:34:59 user nova-compute[72803]: WARNING nova.compute.manager [req-599a3d14-ef90-4d69-b833-ac5aaebb29ed req-d09987eb-aa6e-43a3-b5cc-ad22639f03b5 service nova] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Received unexpected event network-vif-plugged-df7354a5-4cc5-41e1-8667-d01a943b7032 for instance with vm_state active and task_state deleting.
Aug 15 07:34:59 user nova-compute[72803]: INFO nova.compute.manager [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Took 0.76 seconds to detach 1 volumes for instance.
Aug 15 07:34:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:34:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:34:59 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Deleted allocations for instance a9abe053-d27e-468e-9828-d7a16a2aef21
Aug 15 07:35:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-090ddc2e-0d18-4786-9e20-8ce19c36da2e tempest-TestVolumeBootPattern-940544162 tempest-TestVolumeBootPattern-940544162-project-member] Lock "a9abe053-d27e-468e-9828-d7a16a2aef21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.837s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:35:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:35:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:35:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:03 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084888.8865292, ec775934-d66c-4dcd-a978-b1c15ca3a5af => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:35:03 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] VM Stopped (Lifecycle Event)
Aug 15 07:35:03 user nova-compute[72803]: DEBUG nova.compute.manager [None req-f2a35923-e2e5-40c5-afe0-b5fcd2a10c01 None None] [instance: ec775934-d66c-4dcd-a978-b1c15ca3a5af] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:35:05 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:35:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:35:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:35:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:35:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updating instance_info_cache with network_info: [{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:35:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:35:12 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:35:12 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:35:12 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.267818450927734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:35:12 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:35:13 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692084898.0032241, a9abe053-d27e-468e-9828-d7a16a2aef21 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:35:13 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] VM Stopped (Lifecycle Event)
Aug 15 07:35:13 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:35:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-5ecdf5b0-f325-4387-806b-fe0b861a3015 None None] [instance: a9abe053-d27e-468e-9828-d7a16a2aef21] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:35:13 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:35:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:13 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:35:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:35:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:35:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:35:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:35:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:35:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:35:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:35:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:35:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:57 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:35:58 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:05 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:06 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:36:07 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:10 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:36:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:36:12 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:13 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:36:13 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:36:13 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.26608657836914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:36:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:36:14 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:36:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:36:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:36:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:36:59 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:37:03 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:05 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:07 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:37:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:37:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:37:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:37:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:37:12 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:37:12 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:37:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 98b88fe2-798c-4160-b698-1680d220da81 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:37:13 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updating instance_info_cache with network_info: [{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:37:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:37:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:37:13 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:37:14 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:37:15 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:37:15 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8886MB free_disk=25.26506805419922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:37:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:37:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:37:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:37:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:37:29 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:37:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:37:31 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:37:31 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:37:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:37:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:37:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:37:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:37:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:37:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:38:03 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:08 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:38:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:38:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:38:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:38:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:38:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:14 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:38:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:38:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:38:14 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:38:14 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:38:14 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 98b88fe2-798c-4160-b698-1680d220da81 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:38:14 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updating instance_info_cache with network_info: [{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:38:15 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:38:16 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:38:16 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:38:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8889MB free_disk=25.264488220214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:38:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:38:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:38:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:03 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:03 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:08 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:39:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:13 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:14 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 98b88fe2-798c-4160-b698-1680d220da81 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updating instance_info_cache with network_info: [{"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-98b88fe2-798c-4160-b698-1680d220da81" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:39:15 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:39:16 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:39:16 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:39:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8870MB free_disk=25.26386260986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 98b88fe2-798c-4160-b698-1680d220da81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:39:16 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:39:18 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:28 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:33 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:43 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:39:48 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:39:58 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "98b88fe2-798c-4160-b698-1680d220da81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "98b88fe2-798c-4160-b698-1680d220da81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "98b88fe2-798c-4160-b698-1680d220da81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:40:00 user nova-compute[72803]: INFO nova.compute.manager [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Terminating instance
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.compute.manager [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Instance destroyed successfully.
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.objects.instance [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lazy-loading 'resources' on Instance uuid 98b88fe2-798c-4160-b698-1680d220da81 {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-531139667',display_name='tempest-ServersNegativeTestJSON-server-531139667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-531139667',id=49,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:31:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5354415c38b24e8ea507ff68916ffa43',ramdisk_id='',reservation_id='r-n8ko7vsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-387859981',owner_user_name='tempest-ServersNegativeTestJSON-387859981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:31:14Z,user_data=None,user_id='ded0c369e6364afbafd178ddc2d0ec74',uuid=98b88fe2-798c-4160-b698-1680d220da81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converting VIF {"id": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "address": "fa:16:3e:0f:9f:bf", "network": {"id": "0d38d215-5ae7-4a61-91a3-f7cdd52b552f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-119295993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5354415c38b24e8ea507ff68916ffa43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6f6feb-29", "ovs_interfaceid": "1d6f6feb-299a-4e25-bb3b-c74d0ca983b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=1d6f6feb-299a-4e25-bb3b-c74d0ca983b2,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6f6feb-29') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG os_vif [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=1d6f6feb-299a-4e25-bb3b-c74d0ca983b2,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6f6feb-29') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d6f6feb-29, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:40:00 user nova-compute[72803]: INFO os_vif [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:9f:bf,bridge_name='br-int',has_traffic_filtering=True,id=1d6f6feb-299a-4e25-bb3b-c74d0ca983b2,network=Network(0d38d215-5ae7-4a61-91a3-f7cdd52b552f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6f6feb-29')
Aug 15 07:40:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Deleting instance files /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81_del
Aug 15 07:40:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Deletion of /opt/stack/data/nova/instances/98b88fe2-798c-4160-b698-1680d220da81_del complete
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-8e17a1ed-17b4-4f35-9a1e-f2dd8153fead req-d6ef11cc-964e-49c9-9edb-9c7d177ae7fb service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received event network-vif-unplugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8e17a1ed-17b4-4f35-9a1e-f2dd8153fead req-d6ef11cc-964e-49c9-9edb-9c7d177ae7fb service nova] Acquiring lock "98b88fe2-798c-4160-b698-1680d220da81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8e17a1ed-17b4-4f35-9a1e-f2dd8153fead req-d6ef11cc-964e-49c9-9edb-9c7d177ae7fb service nova] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-8e17a1ed-17b4-4f35-9a1e-f2dd8153fead req-d6ef11cc-964e-49c9-9edb-9c7d177ae7fb service nova] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-8e17a1ed-17b4-4f35-9a1e-f2dd8153fead req-d6ef11cc-964e-49c9-9edb-9c7d177ae7fb service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] No waiting events found dispatching network-vif-unplugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.compute.manager [req-8e17a1ed-17b4-4f35-9a1e-f2dd8153fead req-d6ef11cc-964e-49c9-9edb-9c7d177ae7fb service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received event network-vif-unplugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:40:00 user nova-compute[72803]: INFO nova.compute.manager [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 07:40:00 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:40:00 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 98b88fe2-798c-4160-b698-1680d220da81] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:40:01 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:40:01 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:01 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Took 0.50 seconds to deallocate network for instance.
Aug 15 07:40:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:40:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:40:01 user nova-compute[72803]: DEBUG nova.compute.manager [req-89b7e318-9edb-4305-9c4f-042b5f0f9908 req-3df375f5-5002-4128-bd53-7be482da319a service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received event network-vif-deleted-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:40:01 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:40:01 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:40:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:40:01 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Deleted allocations for instance 98b88fe2-798c-4160-b698-1680d220da81
Aug 15 07:40:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-952f44c6-d848-4849-9283-cfe7236fd7fc tempest-ServersNegativeTestJSON-387859981 tempest-ServersNegativeTestJSON-387859981-project-member] Lock "98b88fe2-798c-4160-b698-1680d220da81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.790s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:40:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3ea82c62-a170-4e30-baca-3be463e613be req-0ef2cc5f-9604-448f-81dd-2fddec8cb3c7 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received event network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:40:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3ea82c62-a170-4e30-baca-3be463e613be req-0ef2cc5f-9604-448f-81dd-2fddec8cb3c7 service nova] Acquiring lock "98b88fe2-798c-4160-b698-1680d220da81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:40:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3ea82c62-a170-4e30-baca-3be463e613be req-0ef2cc5f-9604-448f-81dd-2fddec8cb3c7 service nova] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:40:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-3ea82c62-a170-4e30-baca-3be463e613be req-0ef2cc5f-9604-448f-81dd-2fddec8cb3c7 service nova] Lock "98b88fe2-798c-4160-b698-1680d220da81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:40:02 user nova-compute[72803]: DEBUG nova.compute.manager [req-3ea82c62-a170-4e30-baca-3be463e613be req-0ef2cc5f-9604-448f-81dd-2fddec8cb3c7 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] No waiting events found dispatching network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:40:02 user nova-compute[72803]: WARNING nova.compute.manager [req-3ea82c62-a170-4e30-baca-3be463e613be req-0ef2cc5f-9604-448f-81dd-2fddec8cb3c7 service nova] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Received unexpected event network-vif-plugged-1d6f6feb-299a-4e25-bb3b-c74d0ca983b2 for instance with vm_state deleted and task_state None.
Aug 15 07:40:03 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:07 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:40:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:40:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692085200.852015, 98b88fe2-798c-4160-b698-1680d220da81 => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:40:15 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 98b88fe2-798c-4160-b698-1680d220da81] VM Stopped (Lifecycle Event)
Aug 15 07:40:15 user nova-compute[72803]: DEBUG nova.compute.manager [None req-e35e6453-d9fb-417c-b7db-9e64f5e12f02 None None] [instance: 98b88fe2-798c-4160-b698-1680d220da81] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:40:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:16 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:40:17 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:40:17 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:40:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.290931701660156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:40:17 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:40:18 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:40:18 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:40:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:40:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:40:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:40:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:52 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:40:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:00 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:11 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:41:13 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:41:16 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:41:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:41:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:41:17 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:41:17 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:41:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.2813720703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:41:17 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:41:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:41:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:41:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:42:02 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:12 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:42:13 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:17 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:18 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:42:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:42:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:42:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:42:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:42:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:42:19 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:42:19 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:42:19 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:42:19 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=25.28005599975586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:42:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:42:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:42:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:42:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:33 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:42:38 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:42:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:42:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:42 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:42:42 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:42:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:53 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:42:56 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:02 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Starting instance... {{(pid=72803) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72803) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 07:43:07 user nova-compute[72803]: INFO nova.compute.claims [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Claim successful on node user
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Start building networks asynchronously for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Allocating IP information in the background. {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] allocate_for_instance() {{(pid=72803) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 07:43:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Start building block device mappings for instance. {{(pid=72803) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Start spawning the instance on the hypervisor. {{(pid=72803) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Creating instance directory {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 07:43:07 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Creating image(s)
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "/opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "/opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "/opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG nova.policy [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e784d18736f4b35b69e11b1b05db7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320729115f7f4651b84569a25ff70dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72803) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.220s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:07 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.197s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk 1073741824 {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718,backing_fmt=raw /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk 1073741824" returned: 0 in 0.064s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "f345e14a1ac90793a1ded3d69f3ed0aebe7e1718" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f345e14a1ac90793a1ded3d69f3ed0aebe7e1718 --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk. size=1073741824 {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG nova.virt.disk.api [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Cannot resize image /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk to a smaller size. {{(pid=72803) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'migration_context' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Created local disks {{(pid=72803) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Ensure instance console log exists: /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/console.log {{(pid=72803) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:08 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Successfully created port: 0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Successfully updated port: 0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Building network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-79837a09-ff58-4a56-aa42-d91867371948 req-ae659b06-a510-4a0f-b447-de26f23d2a7f service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received event network-changed-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.compute.manager [req-79837a09-ff58-4a56-aa42-d91867371948 req-ae659b06-a510-4a0f-b447-de26f23d2a7f service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Refreshing instance network info cache due to event network-changed-0c9d8639-59a0-4296-9371-e1b4f96e3c7f. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-79837a09-ff58-4a56-aa42-d91867371948 req-ae659b06-a510-4a0f-b447-de26f23d2a7f service nova] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Instance cache missing network info. {{(pid=72803) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.neutron [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Instance network_info: |[{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72803) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-79837a09-ff58-4a56-aa42-d91867371948 req-ae659b06-a510-4a0f-b447-de26f23d2a7f service nova] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.neutron [req-79837a09-ff58-4a56-aa42-d91867371948 req-ae659b06-a510-4a0f-b447-de26f23d2a7f service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Refreshing network info cache for port 0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Start _get_guest_xml network_info=[{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'image_id': '058dab3c-04e2-4357-a904-efeb3f5412a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 07:43:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:43:09 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] CPU controller missing on host. {{(pid=72803) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.host [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] CPU controller found on host. {{(pid=72803) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72803) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T06:51:36Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:51:47Z,direct_url=<?>,disk_format='qcow2',id=058dab3c-04e2-4357-a904-efeb3f5412a5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5c511622b69f44c9977c15fb910de171',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:51:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Flavor limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Image limits 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Flavor pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Image pref 0:0:0 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72803) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Got 1 possible topologies {{(pid=72803) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.hardware [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72803) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1609514373',display_name='tempest-SnapshotDataIntegrityTests-server-1609514373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1609514373',id=52,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU3zgMwKpV5Y9OipfrZdIoH1aLSb3G2Fe6LxNIQUlbPtvNC6U43gVRfe/CppirwIo5lZBDA4u6jENv+ipGA1OWzCegQA661Qg9XUB83luHNWG0b7LiArKHNyAnQ6gS/qA==',key_name='tempest-keypair-1566045556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='320729115f7f4651b84569a25ff70dcd',ramdisk_id='',reservation_id='r-kh2sfy7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-772746262',owner_user_name='tempest-SnapshotDataIntegrityTests-772746262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e784d18736f4b35b69e11b1b05db7e2',uuid=83a044b6-0c52-4eeb-aba9-2895cb00a99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72803) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Converting VIF {"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:03:84,bridge_name='br-int',has_traffic_filtering=True,id=0c9d8639-59a0-4296-9371-e1b4f96e3c7f,network=Network(b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d8639-59') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.objects.instance [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'pci_devices' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 07:43:09 user nova-compute[72803]:   <uuid>83a044b6-0c52-4eeb-aba9-2895cb00a99f</uuid>
Aug 15 07:43:09 user nova-compute[72803]:   <name>instance-00000034</name>
Aug 15 07:43:09 user nova-compute[72803]:   <memory>524288</memory>
Aug 15 07:43:09 user nova-compute[72803]:   <vcpu>1</vcpu>
Aug 15 07:43:09 user nova-compute[72803]:   <metadata>
Aug 15 07:43:09 user nova-compute[72803]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 07:43:09 user nova-compute[72803]:       <nova:package version="0.0.0"/>
Aug 15 07:43:09 user nova-compute[72803]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1609514373</nova:name>
Aug 15 07:43:09 user nova-compute[72803]:       <nova:creationTime>2023-08-15 07:43:09</nova:creationTime>
Aug 15 07:43:09 user nova-compute[72803]:       <nova:flavor name="m1.tiny">
Aug 15 07:43:09 user nova-compute[72803]:         <nova:memory>512</nova:memory>
Aug 15 07:43:09 user nova-compute[72803]:         <nova:disk>1</nova:disk>
Aug 15 07:43:09 user nova-compute[72803]:         <nova:swap>0</nova:swap>
Aug 15 07:43:09 user nova-compute[72803]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 07:43:09 user nova-compute[72803]:         <nova:vcpus>1</nova:vcpus>
Aug 15 07:43:09 user nova-compute[72803]:       </nova:flavor>
Aug 15 07:43:09 user nova-compute[72803]:       <nova:owner>
Aug 15 07:43:09 user nova-compute[72803]:         <nova:user uuid="1e784d18736f4b35b69e11b1b05db7e2">tempest-SnapshotDataIntegrityTests-772746262-project-member</nova:user>
Aug 15 07:43:09 user nova-compute[72803]:         <nova:project uuid="320729115f7f4651b84569a25ff70dcd">tempest-SnapshotDataIntegrityTests-772746262</nova:project>
Aug 15 07:43:09 user nova-compute[72803]:       </nova:owner>
Aug 15 07:43:09 user nova-compute[72803]:       <nova:root type="image" uuid="058dab3c-04e2-4357-a904-efeb3f5412a5"/>
Aug 15 07:43:09 user nova-compute[72803]:       <nova:ports>
Aug 15 07:43:09 user nova-compute[72803]:         <nova:port uuid="0c9d8639-59a0-4296-9371-e1b4f96e3c7f">
Aug 15 07:43:09 user nova-compute[72803]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 07:43:09 user nova-compute[72803]:         </nova:port>
Aug 15 07:43:09 user nova-compute[72803]:       </nova:ports>
Aug 15 07:43:09 user nova-compute[72803]:     </nova:instance>
Aug 15 07:43:09 user nova-compute[72803]:   </metadata>
Aug 15 07:43:09 user nova-compute[72803]:   <sysinfo type="smbios">
Aug 15 07:43:09 user nova-compute[72803]:     <system>
Aug 15 07:43:09 user nova-compute[72803]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 07:43:09 user nova-compute[72803]:       <entry name="product">OpenStack Nova</entry>
Aug 15 07:43:09 user nova-compute[72803]:       <entry name="version">0.0.0</entry>
Aug 15 07:43:09 user nova-compute[72803]:       <entry name="serial">83a044b6-0c52-4eeb-aba9-2895cb00a99f</entry>
Aug 15 07:43:09 user nova-compute[72803]:       <entry name="uuid">83a044b6-0c52-4eeb-aba9-2895cb00a99f</entry>
Aug 15 07:43:09 user nova-compute[72803]:       <entry name="family">Virtual Machine</entry>
Aug 15 07:43:09 user nova-compute[72803]:     </system>
Aug 15 07:43:09 user nova-compute[72803]:   </sysinfo>
Aug 15 07:43:09 user nova-compute[72803]:   <os>
Aug 15 07:43:09 user nova-compute[72803]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 07:43:09 user nova-compute[72803]:     <boot dev="hd"/>
Aug 15 07:43:09 user nova-compute[72803]:     <smbios mode="sysinfo"/>
Aug 15 07:43:09 user nova-compute[72803]:   </os>
Aug 15 07:43:09 user nova-compute[72803]:   <features>
Aug 15 07:43:09 user nova-compute[72803]:     <acpi/>
Aug 15 07:43:09 user nova-compute[72803]:     <apic/>
Aug 15 07:43:09 user nova-compute[72803]:     <vmcoreinfo/>
Aug 15 07:43:09 user nova-compute[72803]:   </features>
Aug 15 07:43:09 user nova-compute[72803]:   <clock offset="utc">
Aug 15 07:43:09 user nova-compute[72803]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 07:43:09 user nova-compute[72803]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 07:43:09 user nova-compute[72803]:     <timer name="hpet" present="no"/>
Aug 15 07:43:09 user nova-compute[72803]:   </clock>
Aug 15 07:43:09 user nova-compute[72803]:   <cpu mode="custom" match="exact">
Aug 15 07:43:09 user nova-compute[72803]:     <model>Nehalem</model>
Aug 15 07:43:09 user nova-compute[72803]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 07:43:09 user nova-compute[72803]:   </cpu>
Aug 15 07:43:09 user nova-compute[72803]:   <devices>
Aug 15 07:43:09 user nova-compute[72803]:     <disk type="file" device="disk">
Aug 15 07:43:09 user nova-compute[72803]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 07:43:09 user nova-compute[72803]:       <source file="/opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk"/>
Aug 15 07:43:09 user nova-compute[72803]:       <target dev="vda" bus="virtio"/>
Aug 15 07:43:09 user nova-compute[72803]:     </disk>
Aug 15 07:43:09 user nova-compute[72803]:     <interface type="ethernet">
Aug 15 07:43:09 user nova-compute[72803]:       <mac address="fa:16:3e:4a:03:84"/>
Aug 15 07:43:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:43:09 user nova-compute[72803]:       <mtu size="1442"/>
Aug 15 07:43:09 user nova-compute[72803]:       <target dev="tap0c9d8639-59"/>
Aug 15 07:43:09 user nova-compute[72803]:     </interface>
Aug 15 07:43:09 user nova-compute[72803]:     <serial type="pty">
Aug 15 07:43:09 user nova-compute[72803]:       <log file="/opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/console.log" append="off"/>
Aug 15 07:43:09 user nova-compute[72803]:     </serial>
Aug 15 07:43:09 user nova-compute[72803]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 07:43:09 user nova-compute[72803]:     <video>
Aug 15 07:43:09 user nova-compute[72803]:       <model type="virtio"/>
Aug 15 07:43:09 user nova-compute[72803]:     </video>
Aug 15 07:43:09 user nova-compute[72803]:     <rng model="virtio">
Aug 15 07:43:09 user nova-compute[72803]:       <backend model="random">/dev/urandom</backend>
Aug 15 07:43:09 user nova-compute[72803]:     </rng>
Aug 15 07:43:09 user nova-compute[72803]:     <controller type="usb" index="0" model="none"/>
Aug 15 07:43:09 user nova-compute[72803]:     <memballoon model="virtio">
Aug 15 07:43:09 user nova-compute[72803]:       <stats period="10"/>
Aug 15 07:43:09 user nova-compute[72803]:     </memballoon>
Aug 15 07:43:09 user nova-compute[72803]:   </devices>
Aug 15 07:43:09 user nova-compute[72803]: </domain>
Aug 15 07:43:09 user nova-compute[72803]:  {{(pid=72803) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1609514373',display_name='tempest-SnapshotDataIntegrityTests-server-1609514373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1609514373',id=52,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU3zgMwKpV5Y9OipfrZdIoH1aLSb3G2Fe6LxNIQUlbPtvNC6U43gVRfe/CppirwIo5lZBDA4u6jENv+ipGA1OWzCegQA661Qg9XUB83luHNWG0b7LiArKHNyAnQ6gS/qA==',key_name='tempest-keypair-1566045556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='320729115f7f4651b84569a25ff70dcd',ramdisk_id='',reservation_id='r-kh2sfy7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-772746262',owner_user_name='tempest-SnapshotDataIntegrityTests-772746262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T07:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e784d18736f4b35b69e11b1b05db7e2',uuid=83a044b6-0c52-4eeb-aba9-2895cb00a99f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Converting VIF {"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:03:84,bridge_name='br-int',has_traffic_filtering=True,id=0c9d8639-59a0-4296-9371-e1b4f96e3c7f,network=Network(b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d8639-59') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG os_vif [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:03:84,bridge_name='br-int',has_traffic_filtering=True,id=0c9d8639-59a0-4296-9371-e1b4f96e3c7f,network=Network(b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d8639-59') {{(pid=72803) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c9d8639-59, may_exist=True, interface_attrs={}) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c9d8639-59, col_values=(('external_ids', {'iface-id': '0c9d8639-59a0-4296-9371-e1b4f96e3c7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:03:84', 'vm-uuid': '83a044b6-0c52-4eeb-aba9-2895cb00a99f'}),), if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:09 user nova-compute[72803]: INFO os_vif [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:03:84,bridge_name='br-int',has_traffic_filtering=True,id=0c9d8639-59a0-4296-9371-e1b4f96e3c7f,network=Network(b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d8639-59')
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:43:09 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No VIF found with MAC fa:16:3e:4a:03:84, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:43:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-79837a09-ff58-4a56-aa42-d91867371948 req-ae659b06-a510-4a0f-b447-de26f23d2a7f service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated VIF entry in instance network info cache for port 0c9d8639-59a0-4296-9371-e1b4f96e3c7f. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:43:10 user nova-compute[72803]: DEBUG nova.network.neutron [req-79837a09-ff58-4a56-aa42-d91867371948 req-ae659b06-a510-4a0f-b447-de26f23d2a7f service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:43:10 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-79837a09-ff58-4a56-aa42-d91867371948 req-ae659b06-a510-4a0f-b447-de26f23d2a7f service nova] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:43:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-1c58b591-60ba-4ff5-92d9-6285d81835c3 req-5a572af2-65ad-477c-a337-eb7f3dba5dbb service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received event network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1c58b591-60ba-4ff5-92d9-6285d81835c3 req-5a572af2-65ad-477c-a337-eb7f3dba5dbb service nova] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1c58b591-60ba-4ff5-92d9-6285d81835c3 req-5a572af2-65ad-477c-a337-eb7f3dba5dbb service nova] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-1c58b591-60ba-4ff5-92d9-6285d81835c3 req-5a572af2-65ad-477c-a337-eb7f3dba5dbb service nova] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG nova.compute.manager [req-1c58b591-60ba-4ff5-92d9-6285d81835c3 req-5a572af2-65ad-477c-a337-eb7f3dba5dbb service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] No waiting events found dispatching network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:43:11 user nova-compute[72803]: WARNING nova.compute.manager [req-1c58b591-60ba-4ff5-92d9-6285d81835c3 req-5a572af2-65ad-477c-a337-eb7f3dba5dbb service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received unexpected event network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f for instance with vm_state building and task_state spawning.
Aug 15 07:43:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:11 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692085393.226439, 83a044b6-0c52-4eeb-aba9-2895cb00a99f => Resumed> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:43:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] VM Resumed (Lifecycle Event)
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Instance event wait completed in 0 seconds for  {{(pid=72803) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Guest created on hypervisor {{(pid=72803) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 07:43:13 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Instance spawned successfully.
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Found default for hw_cdrom_bus of ide {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Found default for hw_disk_bus of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Found default for hw_input_bus of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Found default for hw_pointer_model of None {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Found default for hw_video_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Found default for hw_vif_model of virtio {{(pid=72803) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 07:43:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.virt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Emitting event <LifecycleEvent: 1692085393.2300048, 83a044b6-0c52-4eeb-aba9-2895cb00a99f => Started> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:43:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] VM Started (Lifecycle Event)
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72803) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 07:43:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 07:43:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:43:13 user nova-compute[72803]: INFO nova.compute.manager [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Took 6.24 seconds to build instance.
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-6f332d4d-be16-4adc-903d-37f189ed0d5d req-7ec62666-44fe-42e0-bf89-38c9dbe32844 service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received event network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6f332d4d-be16-4adc-903d-37f189ed0d5d req-7ec62666-44fe-42e0-bf89-38c9dbe32844 service nova] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6f332d4d-be16-4adc-903d-37f189ed0d5d req-7ec62666-44fe-42e0-bf89-38c9dbe32844 service nova] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-6f332d4d-be16-4adc-903d-37f189ed0d5d req-7ec62666-44fe-42e0-bf89-38c9dbe32844 service nova] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:13 user nova-compute[72803]: DEBUG nova.compute.manager [req-6f332d4d-be16-4adc-903d-37f189ed0d5d req-7ec62666-44fe-42e0-bf89-38c9dbe32844 service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] No waiting events found dispatching network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:43:13 user nova-compute[72803]: WARNING nova.compute.manager [req-6f332d4d-be16-4adc-903d-37f189ed0d5d req-7ec62666-44fe-42e0-bf89-38c9dbe32844 service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received unexpected event network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f for instance with vm_state active and task_state None.
Aug 15 07:43:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-3e7b8df8-bffc-478f-b0f0-bca76a5fdeac tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.345s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:14 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:14 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:43:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:15 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:17 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:19 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:43:20 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:43:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.276710510253906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:43:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:43:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:43:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:28 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_power_states {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:43:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Triggering sync for uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 07:43:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:43:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:43:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:43:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:43:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:43:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:43:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:43:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:43:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:43:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:43:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:43:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:43:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:44:07 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:44:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:44:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:44:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:44:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:16 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:16 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:44:17 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:44:20 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:44:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:44:21 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:44:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=25.248271942138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:44:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:44:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:44:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:44:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:44:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:44:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:44:22 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:44:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:44:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:44:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:44:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:44:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:44:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:44:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:44:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:44:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:44:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:44:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:44:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:44:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:44:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:44:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:44:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:44:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:44:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:44:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:44:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:44:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-fcb52ab7-3629-4d73-bb46-1b2c8870ce0e req-6f20b7ec-b42e-4ae4-ba82-649b388d2a93 service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received event network-changed-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:44:58 user nova-compute[72803]: DEBUG nova.compute.manager [req-fcb52ab7-3629-4d73-bb46-1b2c8870ce0e req-6f20b7ec-b42e-4ae4-ba82-649b388d2a93 service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Refreshing instance network info cache due to event network-changed-0c9d8639-59a0-4296-9371-e1b4f96e3c7f. {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 07:44:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fcb52ab7-3629-4d73-bb46-1b2c8870ce0e req-6f20b7ec-b42e-4ae4-ba82-649b388d2a93 service nova] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:44:58 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fcb52ab7-3629-4d73-bb46-1b2c8870ce0e req-6f20b7ec-b42e-4ae4-ba82-649b388d2a93 service nova] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:44:58 user nova-compute[72803]: DEBUG nova.network.neutron [req-fcb52ab7-3629-4d73-bb46-1b2c8870ce0e req-6f20b7ec-b42e-4ae4-ba82-649b388d2a93 service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Refreshing network info cache for port 0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 07:44:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-fcb52ab7-3629-4d73-bb46-1b2c8870ce0e req-6f20b7ec-b42e-4ae4-ba82-649b388d2a93 service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated VIF entry in instance network info cache for port 0c9d8639-59a0-4296-9371-e1b4f96e3c7f. {{(pid=72803) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 07:44:59 user nova-compute[72803]: DEBUG nova.network.neutron [req-fcb52ab7-3629-4d73-bb46-1b2c8870ce0e req-6f20b7ec-b42e-4ae4-ba82-649b388d2a93 service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:44:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-fcb52ab7-3629-4d73-bb46-1b2c8870ce0e req-6f20b7ec-b42e-4ae4-ba82-649b388d2a93 service nova] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:44:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:45:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:45:02 user nova-compute[72803]: DEBUG nova.objects.instance [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:45:02 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:45:03 user nova-compute[72803]: INFO nova.compute.manager [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attaching volume 54596426-3de6-40f1-9191-ccc8052c7721 to /dev/vdb
Aug 15 07:45:03 user nova-compute[72803]: DEBUG os_brick.utils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[136337b1-83ca-4e50-b13b-4fe4bf7c4fa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3447e11-f345-4a5a-97ae-204f99d2ff46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec3de87-47a7-4111-8df0-6364ebd0454d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[732819ba-242e-4825-b401-be53ed0d8376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:45:03 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:45:03 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1963cec1-767e-4406-aa01-86331ff32cfb]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG os_brick.utils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:45:03 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating existing volume attachment record: 8fac6fb6-f907-4939-ad43-8f456b178753 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:45:04 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfGyVHXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:45:11 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:45:11 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:45:11 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae1b75f-b593-4030-b6d6-ab92c71f040c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:45:11 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f89982-25c3-48ea-859a-aebf9a78db5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721] added
Aug 15 07:45:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[90516306-bab2-4239-ba82-228989114338]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2af4a8-b80b-4e6b-b5b1-492381857b09]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfGyVHXi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfGyVHXi" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[51224b1a-7f2a-4964-8f1c-3d7b354a05c6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EfGyVHXi'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[039501a1-ed7b-4f05-b373-245e6ea015fd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ac9af-07de-4d91-9c3c-9a6f413225fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:45:11 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:45:11 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:45:11 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 07:45:11 user nova-compute[72803]: 
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[904b7d6f-c7ea-426b-9d73-cb219f988612]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721, portal: 172.16.0.220,3260]
Aug 15 07:45:11 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721, portal: 172.16.0.220,3260] successful.
Aug 15 07:45:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bf7d45-0ad2-4d9b-bb86-84f641224b01]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eec5d94-df2d-4800-8b5b-98a3044587fd]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 (non-flash)
Aug 15 07:45:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 (non-flash)
Aug 15 07:45:11 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[643e04ad-c786-4edf-a25f-985c2343541b]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:45:11 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfGyVHXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:45:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:45:12 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23966623037343034', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:45:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966623037343034', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:45:12 user nova-compute[72803]: DEBUG nova.objects.instance [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:45:12 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:45:12 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:45:12 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:45:12 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:45:12 user nova-compute[72803]:   <serial>54596426-3de6-40f1-9191-ccc8052c7721</serial>
Aug 15 07:45:12 user nova-compute[72803]: </disk>
Aug 15 07:45:12 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:45:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:45:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:45:13 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No VIF found with MAC fa:16:3e:4a:03:84, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:45:13 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-4db54721-697c-4515-9632-12e30ff03a5a tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.345s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:45:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:45:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:45:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:45:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:45:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:18 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:18 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:18 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:45:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:21 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:45:21 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:45:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:45:21 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:45:21 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:45:21 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:22 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72803) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 07:45:23 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:45:23 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:45:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=25.24715805053711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:45:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:45:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:45:39 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:45:39 user nova-compute[72803]: INFO nova.compute.manager [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Detaching volume 54596426-3de6-40f1-9191-ccc8052c7721
Aug 15 07:45:39 user nova-compute[72803]: INFO nova.virt.block_device [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attempting to driver detach volume 54596426-3de6-40f1-9191-ccc8052c7721 from mountpoint /dev/vdb
Aug 15 07:45:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Attempting to detach device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:45:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:45:39 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:45:39 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:45:39 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:45:39 user nova-compute[72803]:   <serial>54596426-3de6-40f1-9191-ccc8052c7721</serial>
Aug 15 07:45:39 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:45:39 user nova-compute[72803]: </disk>
Aug 15 07:45:39 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:45:39 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully detached device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the persistent domain config.
Aug 15 07:45:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:45:39 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:45:39 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:45:39 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:45:39 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:45:39 user nova-compute[72803]:   <serial>54596426-3de6-40f1-9191-ccc8052c7721</serial>
Aug 15 07:45:39 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:45:39 user nova-compute[72803]: </disk>
Aug 15 07:45:39 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:45:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692085540.3623517, 83a044b6-0c52-4eeb-aba9-2895cb00a99f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:45:40 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully detached device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the live domain config.
Aug 15 07:45:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfGyVHXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:45:40 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10679724-0448-4dd8-9ac4-9044e4f10c4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2404430-e802-442c-a13e-c6d829d9e545]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 (non-flash)
Aug 15 07:45:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 (non-flash)
Aug 15 07:45:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c05eb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd0d95-02a9-4468-8a3f-a06b3fd0c2c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[323b6b17-ae52-4102-8fda-c4b3a63e2fba]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79b1a04-da96-4c9d-9c7e-0142f38bf6dd]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbe0923-d5ad-4647-9bc1-12a2cab03da2]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b8d50-94c5-45f7-8b34-b2ece41837d4]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[77be7a86-b5e4-4eef-9e20-705a4385a199]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721, portal: 172.16.0.220,3260]
Aug 15 07:45:40 user nova-compute[72803]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721, portal: 172.16.0.220,3260] successful.
Aug 15 07:45:40 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54596426-3de6-40f1-9191-ccc8052c7721 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd74ac02-4f92-4d65-be66-87feac9f6d0c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== disconnect_volume: return (283ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:45:40 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:45:41 user nova-compute[72803]: DEBUG nova.objects.instance [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:45:41 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-745d7520-d3d0-43ad-a1b0-c75405d1f510 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:45:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:45:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:45:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:45:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:45:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:45:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:45:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:45:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:46:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:46:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:07 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:09 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:10 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:46:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:20 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:20 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:46:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:46:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:46:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:46:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:46:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:46:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:25 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:46:25 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:46:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.24626922607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:46:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:46:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:46:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:46:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:46:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:46:33 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:46:33 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:46:34 user nova-compute[72803]: INFO nova.compute.manager [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attaching volume 0533ad20-2f8c-4839-9305-7a74b8c3727c to /dev/vdb
Aug 15 07:46:34 user nova-compute[72803]: DEBUG os_brick.utils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4669b012-9e10-439b-a8aa-4eefb1b69ff4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccac316-ade3-48d7-90f6-850894859f32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4f7d81-26a4-465b-a3c5-db278caf728d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa7a05f-5f9a-4ffe-b50d-c9a548bfd2ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:46:34 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:46:34 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a66a1-849c-4a5e-b0ce-80f0a349a934]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG os_brick.utils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:46:34 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating existing volume attachment record: 76d12a93-9d40-42f4-a5a3-64a63e2b33ba {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:46:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXLJQrmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:46:42 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:46:42 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:46:42 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b2d3e-452f-4301-9420-868fe3af9ebd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:46:42 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0171d99-c74c-4256-bf99-91e560baa2a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c] added
Aug 15 07:46:42 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4659437-2985-4404-ba63-045712b8ff20]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bcdd8a-6856-4ccc-a56a-673201630ab6]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXLJQrmK {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXLJQrmK" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e66aaf3-1a9d-4d3e-9ce2-f6897f649193]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXLJQrmK'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81c8e4e-045d-45b8-986f-e769a1967321]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[851041fa-6942-436f-9960-b0216e029c1d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:46:42 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:46:42 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:46:42 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 07:46:42 user nova-compute[72803]: 
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[df837a4f-7a0e-47b2-b5e2-788c9c9bc32a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c, portal: 172.16.0.220,3260]
Aug 15 07:46:42 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c, portal: 172.16.0.220,3260] successful.
Aug 15 07:46:42 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e7b887-513a-441f-a539-2502f7e99339]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5656dfb-00f7-4fe2-a849-d457e0f6b9c5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c (non-flash)
Aug 15 07:46:42 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c (non-flash)
Aug 15 07:46:42 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b701778c-a487-444e-9d42-19d966fddf51]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:46:42 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXLJQrmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:46:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:46:43 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23030366562633161', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:46:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030366562633161', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:46:43 user nova-compute[72803]: DEBUG nova.objects.instance [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:46:43 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:46:43 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:46:43 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:46:43 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:46:43 user nova-compute[72803]:   <serial>0533ad20-2f8c-4839-9305-7a74b8c3727c</serial>
Aug 15 07:46:43 user nova-compute[72803]: </disk>
Aug 15 07:46:43 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:46:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:46:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:46:44 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No VIF found with MAC fa:16:3e:4a:03:84, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:46:44 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-f5f2a8fa-8026-4023-a17b-f4a883130b62 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.226s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:46:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:46:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:46:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:46:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:46:46 user nova-compute[72803]: INFO nova.compute.manager [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Detaching volume 0533ad20-2f8c-4839-9305-7a74b8c3727c
Aug 15 07:46:46 user nova-compute[72803]: INFO nova.virt.block_device [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attempting to driver detach volume 0533ad20-2f8c-4839-9305-7a74b8c3727c from mountpoint /dev/vdb
Aug 15 07:46:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Attempting to detach device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:46:46 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:46:46 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:46:46 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:46:46 user nova-compute[72803]:   <serial>0533ad20-2f8c-4839-9305-7a74b8c3727c</serial>
Aug 15 07:46:46 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:46:46 user nova-compute[72803]: </disk>
Aug 15 07:46:46 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:46:46 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully detached device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the persistent domain config.
Aug 15 07:46:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:46:46 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:46:46 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:46:46 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:46:46 user nova-compute[72803]:   <serial>0533ad20-2f8c-4839-9305-7a74b8c3727c</serial>
Aug 15 07:46:46 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:46:46 user nova-compute[72803]: </disk>
Aug 15 07:46:46 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692085606.8321495, 83a044b6-0c52-4eeb-aba9-2895cb00a99f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:46:46 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully detached device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the live domain config.
Aug 15 07:46:46 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXLJQrmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:46:46 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d220f82-e8e0-4e02-9773-7d0c68c37fe8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f23bcc6-9677-44a6-858f-90b4d416d51a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c (non-flash)
Aug 15 07:46:46 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c (non-flash)
Aug 15 07:46:46 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3500105990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae0ffc-6364-47bc-b233-638b6ca54bb3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a79d891-2f0a-46c7-9ec9-6e392448c5ab]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa8b7e-f37c-4bc3-b8a6-01f610c759a1]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:46:46 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5c0d14-21a5-4329-a1eb-34f09aea2ad4]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb94a3e1-849a-4a13-b03d-ca6f44db2e8f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e79238-08e9-46ed-b1ff-92a92bd61400]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c, portal: 172.16.0.220,3260]
Aug 15 07:46:47 user nova-compute[72803]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c, portal: 172.16.0.220,3260] successful.
Aug 15 07:46:47 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0533ad20-2f8c-4839-9305-7a74b8c3727c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8116ad4-70e8-4cf6-b060-9dc2a8bb6444]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== disconnect_volume: return (323ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG nova.objects.instance [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:46:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-2884c031-0e1e-4500-8989-ad215fea0bf2 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:46:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:46:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:47:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:47:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:06 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:47:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:13 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:22 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:22 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:47:23 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:47:23 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:47:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:47:23 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:47:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:47:23 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:47:23 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:24 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:47:24 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:47:24 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=25.245258331298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:47:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing inventories for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating ProviderTree inventory for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Updating inventory in ProviderTree for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing aggregate associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, aggregates: None {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Refreshing trait associations for resource provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c, traits: COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI {{(pid=72803) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:47:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:47:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:47:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:39 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 07:47:39 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] There are 0 instances to clean {{(pid=72803) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG nova.objects.instance [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:47:40 user nova-compute[72803]: INFO nova.compute.manager [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attaching volume e465779f-4c46-4935-9ac2-43a20f02a437 to /dev/vdb
Aug 15 07:47:40 user nova-compute[72803]: DEBUG os_brick.utils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b53726-d5b2-403f-949c-c99f5c5ea132]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0dbbb2-b254-4333-9217-77179950a9d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18bff33-6c65-4d9b-9a8d-e7c8466cc9a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93b3cc1-be79-49d4-809f-bdfc9a7837b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:47:40 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:47:40 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[938b3857-9399-4a44-a2c8-89c49f9a179f]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG os_brick.utils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:47:40 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating existing volume attachment record: 3b419385-d9a5-4a16-bad0-ce809f8046b8 {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:47:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:47 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZlbMGda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:47:49 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:47:49 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:47:49 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c7d077-4d01-494c-b47b-a77d84fd9ead]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:47:49 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[67146863-88a3-47a7-95c3-a0a8ef750d66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437] added
Aug 15 07:47:49 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb24d6-fda3-4d40-b8aa-7f111c0137ec]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac99ad0a-af64-463b-a58b-b9f40e22b7f8]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZlbMGda {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fZlbMGda" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5129e9cd-ab39-4413-86dc-a62f7f5862ce]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fZlbMGda'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[da46781d-a9b3-40ec-b7ea-644addf8515a]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[228692e5-edb3-4c5e-ac2d-bb3ed534e0f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:47:49 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:47:49 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:47:49 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 07:47:49 user nova-compute[72803]: 
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9bbd9e-50f1-47ea-9f0f-83e131d82f2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437, portal: 172.16.0.220,3260]
Aug 15 07:47:49 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437, portal: 172.16.0.220,3260] successful.
Aug 15 07:47:49 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f6ae7-eb37-4b73-b0a3-d9189f263518]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a26663f-7c56-4248-b714-23a4194391e6]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 (non-flash)
Aug 15 07:47:49 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 (non-flash)
Aug 15 07:47:49 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1e2d30-302e-4d9c-ac01-aa4e0e33ac73]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:47:49 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Cleaning up deleted instances with incomplete migration  {{(pid=72803) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZlbMGda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23131643435303730', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131643435303730', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG nova.objects.instance [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:47:50 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:47:50 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:47:50 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:47:50 user nova-compute[72803]:   <serial>e465779f-4c46-4935-9ac2-43a20f02a437</serial>
Aug 15 07:47:50 user nova-compute[72803]: </disk>
Aug 15 07:47:50 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:47:50 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No VIF found with MAC fa:16:3e:4a:03:84, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:47:51 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-0a8351ad-bece-44e9-ad36-0173e41d875e tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.233s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:47:53 user nova-compute[72803]: INFO nova.compute.manager [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Detaching volume e465779f-4c46-4935-9ac2-43a20f02a437
Aug 15 07:47:53 user nova-compute[72803]: INFO nova.virt.block_device [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attempting to driver detach volume e465779f-4c46-4935-9ac2-43a20f02a437 from mountpoint /dev/vdb
Aug 15 07:47:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Attempting to detach device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:47:53 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:47:53 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:47:53 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:47:53 user nova-compute[72803]:   <serial>e465779f-4c46-4935-9ac2-43a20f02a437</serial>
Aug 15 07:47:53 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:47:53 user nova-compute[72803]: </disk>
Aug 15 07:47:53 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:47:53 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully detached device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the persistent domain config.
Aug 15 07:47:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:47:53 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:47:53 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:47:53 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:47:53 user nova-compute[72803]:   <serial>e465779f-4c46-4935-9ac2-43a20f02a437</serial>
Aug 15 07:47:53 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:47:53 user nova-compute[72803]: </disk>
Aug 15 07:47:53 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692085673.6187327, 83a044b6-0c52-4eeb-aba9-2895cb00a99f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:47:53 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully detached device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the live domain config.
Aug 15 07:47:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fZlbMGda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:47:53 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8b11f1-5de5-447e-a1ca-7dea84e99dd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1302991b-a06b-40d0-9c07-623bd9cc64cd]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 (non-flash)
Aug 15 07:47:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 (non-flash)
Aug 15 07:47:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f34c06a7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a98228-86ef-41bd-9f77-042f0a71b1c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ece053-a248-4ddf-9c15-e556828fd2bc]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb3e96b-c202-4370-befd-329217a654d7]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e90dd9e-6060-434c-b5d2-3fdae08e615f]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667041d-7663-40ce-9e39-5c3ae79bd2f9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[248cb62f-cda4-4c60-b758-0807ea0274cd]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437, portal: 172.16.0.220,3260]
Aug 15 07:47:53 user nova-compute[72803]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437, portal: 172.16.0.220,3260] successful.
Aug 15 07:47:53 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e465779f-4c46-4935-9ac2-43a20f02a437 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62a957d-2aa5-46f5-8f9b-21229ce71b89]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== disconnect_volume: return (266ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:47:53 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:47:54 user nova-compute[72803]: DEBUG nova.objects.instance [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:47:54 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-e01d1058-f075-4380-b2c3-70dfebe02529 tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.583s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:47:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:47:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:47:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:47:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:47:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:08 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:48:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:48:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:48:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:13 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:15 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:48:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:48:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:48:24 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:48:24 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:48:24 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:25 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:26 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:48:26 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:48:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=25.24429702758789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:48:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:48:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:30 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:48:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:48:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:48:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:48:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG nova.objects.instance [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:48:47 user nova-compute[72803]: INFO nova.compute.manager [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attaching volume ded1df8b-a8dc-4db8-8775-b77366ab9eb8 to /dev/vdb
Aug 15 07:48:47 user nova-compute[72803]: DEBUG os_brick.utils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9572f855-532e-41e6-9def-f1e73c1d4d44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778bcb9ad487\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3366bf5-e883-4840-b394-ae569f9fe354]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df12093-d9c3-4256-b0d4-32326ce27aea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da8c358-4900-4a8c-8e3a-7a9427e74013]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Running cmd (subprocess): nvme version {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.nvmeof [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] nvme not present on system {{(pid=72803) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 07:48:47 user nova-compute[72803]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 07:48:47 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5129659-f291-409b-8ac8-19e5bcfd19d9]: (4, '') {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72803) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.lightos [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] LIGHTOS: no hostnqn found. {{(pid=72803) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG os_brick.utils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778bcb9ad487', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:48:47 user nova-compute[72803]: DEBUG nova.virt.block_device [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating existing volume attachment record: deed795c-3dd9-420d-8829-f204393aeaac {{(pid=72803) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 07:48:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:48:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Calling os-brick to attach iSCSI Volume {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOWKZenD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:48:55 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:48:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:48:55 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:48:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:48:55 user nova-compute[72803]: INFO os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 07:48:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11828a2-4173-49bb-931c-d3ecb4b536c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 07:48:55 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79f391d-21f5-42ee-81ce-a8645fbf36ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8] added\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8] added
Aug 15 07:48:55 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:48:55 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf47e938-900f-4b43-963a-b65f660dd19c]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cae4c8-fcc5-45fa-8f61-e7179dba1b71]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fOWKZenD {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fOWKZenD" returned: 0 in 0.027s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[153c3dd9-6698-40da-abb9-7a40a1f2b0b0]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fOWKZenD'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[87383d02-1d67-486b-8495-1f68f76dd91f]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2114ad63-249f-4567-a9b3-99f54959587c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:48:56 user nova-compute[72803]:  {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 07:48:56 user nova-compute[72803]:  {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:48:56 user nova-compute[72803]: WARNING os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 07:48:56 user nova-compute[72803]: 
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --login {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[40650484-68ce-45b2-bb69-ecf22588b3e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8, portal: 172.16.0.220,3260]
Aug 15 07:48:56 user nova-compute[72803]: Login to [iface: default, target: iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8, portal: 172.16.0.220,3260] successful.
Aug 15 07:48:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c1d19-6dd3-4701-a062-ccdd6ec8c9ce]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919bd9b-c48f-40e7-8df0-05a6100ade4c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 (non-flash)
Aug 15 07:48:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 (non-flash)
Aug 15 07:48:56 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Connected to 172.16.0.220:3260 {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72803) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72803) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4826d199-c43a-4141-bf48-c145c13ade16]: (4, ('- - 0', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:48:56 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72803) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOWKZenD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72803) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23630623039353236', 'path': '/dev/sdb'} {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630623039353236', 'path': '/dev/sdb'} {{(pid=72803) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG nova.objects.instance [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 07:48:57 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:48:57 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:48:57 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:48:57 user nova-compute[72803]:   <serial>ded1df8b-a8dc-4db8-8775-b77366ab9eb8</serial>
Aug 15 07:48:57 user nova-compute[72803]: </disk>
Aug 15 07:48:57 user nova-compute[72803]:  {{(pid=72803) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72803) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] No VIF found with MAC fa:16:3e:4a:03:84, not building metadata {{(pid=72803) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 07:48:57 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-214036df-1b42-4c9d-a8db-c282a2628f4f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.246s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:48:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:48:59 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:48:59 user nova-compute[72803]: INFO nova.compute.manager [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Detaching volume ded1df8b-a8dc-4db8-8775-b77366ab9eb8
Aug 15 07:48:59 user nova-compute[72803]: INFO nova.virt.block_device [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Attempting to driver detach volume ded1df8b-a8dc-4db8-8775-b77366ab9eb8 from mountpoint /dev/vdb
Aug 15 07:48:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Attempting to detach device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the persistent domain config. {{(pid=72803) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 07:48:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:48:59 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:48:59 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:48:59 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:48:59 user nova-compute[72803]:   <serial>ded1df8b-a8dc-4db8-8775-b77366ab9eb8</serial>
Aug 15 07:48:59 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:48:59 user nova-compute[72803]: </disk>
Aug 15 07:48:59 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:48:59 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully detached device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the persistent domain config.
Aug 15 07:48:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the live domain config. {{(pid=72803) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 07:48:59 user nova-compute[72803]: DEBUG nova.virt.libvirt.guest [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 07:48:59 user nova-compute[72803]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 07:48:59 user nova-compute[72803]:   <source dev="/dev/sdb"/>
Aug 15 07:48:59 user nova-compute[72803]:   <target dev="vdb" bus="virtio"/>
Aug 15 07:48:59 user nova-compute[72803]:   <serial>ded1df8b-a8dc-4db8-8775-b77366ab9eb8</serial>
Aug 15 07:48:59 user nova-compute[72803]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 07:48:59 user nova-compute[72803]: </disk>
Aug 15 07:48:59 user nova-compute[72803]:  {{(pid=72803) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-3dba6e72-a53d-4b51-9a19-8f4a51619df2 None None] Received event <DeviceRemovedEvent: 1692085740.3078325, 83a044b6-0c52-4eeb-aba9-2895cb00a99f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72803) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.driver [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:00 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully detached device vdb from instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f from the live domain config.
Aug 15 07:49:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] calling os-brick to detach iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f34e07243a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOWKZenD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 07:49:00 user nova-compute[72803]: WARNING os_brick.initiator.connectors.base [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8', 0)] {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d77e48-7244-4b32-a34c-2c3a2b04334a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e44d26-177d-40e9-9b70-a19129d2c846]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 (non-flash)\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 (non-flash)
Aug 15 07:49:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 (non-flash)
Aug 15 07:49:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f350c91e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8'): ({'sdb'}, set())}) {{(pid=72803) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Removing single pathed devices sdb {{(pid=72803) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b115726-ad25-42c0-b8a8-cd90824933ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4905d6-084a-44b1-8d6f-cb7da33fdb8a]: (4, ('ok\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Flushing IO for device /dev/sdb {{(pid=72803) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc89c3c-008d-43d5-b65f-1f58a18574f9]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72803) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5bbacb-5ae6-4fd1-983e-0aa2890b7a2e]: (4, ('1', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.linuxscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] SCSI volumes sdb have been removed. {{(pid=72803) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8')] {{(pid=72803) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7650557-4bfc-4c1c-a316-d72562c0aa90]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --logout {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ce3610-ad76-46cc-bb75-30145cb7e0fc]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8, portal: 172.16.0.220,3260]
Aug 15 07:49:00 user nova-compute[72803]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8, portal: 172.16.0.220,3260] successful.
Aug 15 07:49:00 user nova-compute[72803]:  stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op delete {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1df8b-a8dc-4db8-8775-b77366ab9eb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84151) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG oslo.privsep.daemon [-] privsep: reply[943333ed-37be-4362-a050-fbc96169c7aa]: (4, ('', '')) {{(pid=84151) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72803) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.base [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] <== disconnect_volume: return (284ms) None {{(pid=72803) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 07:49:00 user nova-compute[72803]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Disconnected iSCSI Volume {{(pid=72803) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 07:49:01 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'flavor' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:49:01 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c9e77437-b782-4890-a40a-989988633e7f tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.555s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:49:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:10 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:11 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:14 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:49:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:49:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:49:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:16 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:24 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:49:25 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:49:26 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:49:27 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:49:27 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:49:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.235450744628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:49:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:49:30 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:35 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:49:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:49:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:49:40 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:45 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:49:50 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:49:55 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:50:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:00 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:50:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:05 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:50:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:10 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:50:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:15 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:16 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:16 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:50:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:20 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:24 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:50:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:25 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:25 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:50:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:50:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:50:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 07:50:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquired lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 07:50:26 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Forcefully refreshing network info cache for instance {{(pid=72803) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 07:50:26 user nova-compute[72803]: DEBUG nova.objects.instance [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lazy-loading 'info_cache' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG nova.network.neutron [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [{"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Releasing lock "refresh_cache-83a044b6-0c52-4eeb-aba9-2895cb00a99f" {{(pid=72803) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updated the network info_cache for instance {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.processutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72803) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 07:50:27 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:50:27 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:50:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=25.23450469970703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:50:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:50:28 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72803) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 07:50:28 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:50:28 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:50:28 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:50:28 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:50:28 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:50:28 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:50:29 user nova-compute[72803]: INFO nova.compute.manager [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Terminating instance
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.compute.manager [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Start destroying the instance on the hypervisor. {{(pid=72803) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-0662374e-ef9a-4344-9d09-c3a48e9a34e3 req-ed94a864-70ae-4417-b030-9733a8f05adb service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received event network-vif-unplugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0662374e-ef9a-4344-9d09-c3a48e9a34e3 req-ed94a864-70ae-4417-b030-9733a8f05adb service nova] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0662374e-ef9a-4344-9d09-c3a48e9a34e3 req-ed94a864-70ae-4417-b030-9733a8f05adb service nova] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-0662374e-ef9a-4344-9d09-c3a48e9a34e3 req-ed94a864-70ae-4417-b030-9733a8f05adb service nova] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-0662374e-ef9a-4344-9d09-c3a48e9a34e3 req-ed94a864-70ae-4417-b030-9733a8f05adb service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] No waiting events found dispatching network-vif-unplugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.compute.manager [req-0662374e-ef9a-4344-9d09-c3a48e9a34e3 req-ed94a864-70ae-4417-b030-9733a8f05adb service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received event network-vif-unplugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f for instance with task_state deleting. {{(pid=72803) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [-] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Instance destroyed successfully.
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.objects.instance [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lazy-loading 'resources' on Instance uuid 83a044b6-0c52-4eeb-aba9-2895cb00a99f {{(pid=72803) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.virt.libvirt.vif [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T07:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1609514373',display_name='tempest-SnapshotDataIntegrityTests-server-1609514373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1609514373',id=52,image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU3zgMwKpV5Y9OipfrZdIoH1aLSb3G2Fe6LxNIQUlbPtvNC6U43gVRfe/CppirwIo5lZBDA4u6jENv+ipGA1OWzCegQA661Qg9XUB83luHNWG0b7LiArKHNyAnQ6gS/qA==',key_name='tempest-keypair-1566045556',keypairs=<?>,launch_index=0,launched_at=2023-08-15T07:43:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='320729115f7f4651b84569a25ff70dcd',ramdisk_id='',reservation_id='r-kh2sfy7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='058dab3c-04e2-4357-a904-efeb3f5412a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-772746262',owner_user_name='tempest-SnapshotDataIntegrityTests-772746262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T07:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e784d18736f4b35b69e11b1b05db7e2',uuid=83a044b6-0c52-4eeb-aba9-2895cb00a99f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Converting VIF {"id": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "address": "fa:16:3e:4a:03:84", "network": {"id": "b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1749067386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320729115f7f4651b84569a25ff70dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9d8639-59", "ovs_interfaceid": "0c9d8639-59a0-4296-9371-e1b4f96e3c7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.network.os_vif_util [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:03:84,bridge_name='br-int',has_traffic_filtering=True,id=0c9d8639-59a0-4296-9371-e1b4f96e3c7f,network=Network(b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d8639-59') {{(pid=72803) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG os_vif [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:03:84,bridge_name='br-int',has_traffic_filtering=True,id=0c9d8639-59a0-4296-9371-e1b4f96e3c7f,network=Network(b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d8639-59') {{(pid=72803) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c9d8639-59, bridge=br-int, if_exists=True) {{(pid=72803) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:29 user nova-compute[72803]: INFO os_vif [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:03:84,bridge_name='br-int',has_traffic_filtering=True,id=0c9d8639-59a0-4296-9371-e1b4f96e3c7f,network=Network(b33e3c5a-0cfb-4ff6-bab9-dbd319069b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9d8639-59')
Aug 15 07:50:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Deleting instance files /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f_del
Aug 15 07:50:29 user nova-compute[72803]: INFO nova.virt.libvirt.driver [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Deletion of /opt/stack/data/nova/instances/83a044b6-0c52-4eeb-aba9-2895cb00a99f_del complete
Aug 15 07:50:29 user nova-compute[72803]: INFO nova.compute.manager [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 07:50:29 user nova-compute[72803]: DEBUG oslo.service.loopingcall [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72803) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.compute.manager [-] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Deallocating network for instance {{(pid=72803) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 07:50:29 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] deallocate_for_instance() {{(pid=72803) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 07:50:30 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:50:30 user nova-compute[72803]: DEBUG nova.network.neutron [-] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Updating instance_info_cache with network_info: [] {{(pid=72803) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 07:50:30 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Took 0.95 seconds to deallocate network for instance.
Aug 15 07:50:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:50:30 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-64e2114d-ff67-417b-a5d1-15402e879e22 req-7033a52d-cdc6-408e-a9d7-033fc882f77b service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received event network-vif-deleted-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:50:31 user nova-compute[72803]: INFO nova.scheduler.client.report [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Deleted allocations for instance 83a044b6-0c52-4eeb-aba9-2895cb00a99f
Aug 15 07:50:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-c90f60dd-faf0-4699-85e4-7d7ff283e0cf tempest-SnapshotDataIntegrityTests-772746262 tempest-SnapshotDataIntegrityTests-772746262-project-member] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-27ae5c59-6d9d-490f-8051-f2152ab57651 req-bf83f30f-821a-4193-a0cf-1821a803164f service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received event network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-27ae5c59-6d9d-490f-8051-f2152ab57651 req-bf83f30f-821a-4193-a0cf-1821a803164f service nova] Acquiring lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-27ae5c59-6d9d-490f-8051-f2152ab57651 req-bf83f30f-821a-4193-a0cf-1821a803164f service nova] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [req-27ae5c59-6d9d-490f-8051-f2152ab57651 req-bf83f30f-821a-4193-a0cf-1821a803164f service nova] Lock "83a044b6-0c52-4eeb-aba9-2895cb00a99f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:50:31 user nova-compute[72803]: DEBUG nova.compute.manager [req-27ae5c59-6d9d-490f-8051-f2152ab57651 req-bf83f30f-821a-4193-a0cf-1821a803164f service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] No waiting events found dispatching network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f {{(pid=72803) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 07:50:31 user nova-compute[72803]: WARNING nova.compute.manager [req-27ae5c59-6d9d-490f-8051-f2152ab57651 req-bf83f30f-821a-4193-a0cf-1821a803164f service nova] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Received unexpected event network-vif-plugged-0c9d8639-59a0-4296-9371-e1b4f96e3c7f for instance with vm_state deleted and task_state None.
Aug 15 07:50:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:50:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:44 user nova-compute[72803]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692085829.8791, 83a044b6-0c52-4eeb-aba9-2895cb00a99f => Stopped> {{(pid=72803) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 07:50:44 user nova-compute[72803]: INFO nova.compute.manager [-] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] VM Stopped (Lifecycle Event)
Aug 15 07:50:44 user nova-compute[72803]: DEBUG nova.compute.manager [None req-7672498b-625f-4f25-b7fa-fbd0318c0bf5 None None] [instance: 83a044b6-0c52-4eeb-aba9-2895cb00a99f] Checking state {{(pid=72803) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 07:50:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:54 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:50:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:50:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:50:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:50:59 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:04 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:51:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:51:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:51:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:51:09 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:12 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:13 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:51:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72803) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 07:51:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:51:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72803) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 07:51:14 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:17 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:18 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:19 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:19 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:23 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:24 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:25 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72803) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager.update_available_resource {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Auditing locally available compute resources for user (node: user) {{(pid=72803) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 07:51:26 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:51:26 user nova-compute[72803]: WARNING nova.virt.libvirt.driver [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 07:51:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=25.261337280273438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72803) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72803) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG nova.compute.provider_tree [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed in ProviderTree for provider: 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c {{(pid=72803) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 07:51:26 user nova-compute[72803]: DEBUG nova.scheduler.client.report [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Inventory has not changed for provider 6051aed2-f8f0-45e9-ae6c-41afa9d24b7c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72803) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 07:51:27 user nova-compute[72803]: DEBUG nova.compute.resource_tracker [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Compute_service record updated for user:user {{(pid=72803) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 07:51:27 user nova-compute[72803]: DEBUG oslo_concurrency.lockutils [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72803) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 07:51:27 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:28 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Starting heal instance info cache {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 07:51:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Rebuilding the list of instances to heal {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 07:51:28 user nova-compute[72803]: DEBUG nova.compute.manager [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Didn't find any instances for network info cache update. {{(pid=72803) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 07:51:28 user nova-compute[72803]: DEBUG oslo_service.periodic_task [None req-cebbf05d-a250-497a-b5d0-1be5aa0388da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72803) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 07:51:29 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 07:51:34 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:51:39 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:51:44 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 07:51:49 user nova-compute[72803]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72803) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}